-- Logs begin at Thu 2022-06-30 09:56:53 UTC, end at Thu 2022-06-30 11:11:28 UTC. -- Jun 30 10:31:38.537078 dv-cinder-822822-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 30 10:31:38.546764 dv-cinder-822822-2-iscsi devstack@n-api.service[109677]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 30 10:31:38.548779 dv-cinder-822822-2-iscsi devstack@n-api.service[109677]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 30 10:31:38 2022] *** Jun 30 10:31:38.548779 dv-cinder-822822-2-iscsi devstack@n-api.service[109677]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 30 10:31:38.548779 dv-cinder-822822-2-iscsi devstack@n-api.service[109677]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 30 10:31:38.548779 dv-cinder-822822-2-iscsi devstack@n-api.service[109677]: nodename: dv-cinder-822822-2-iscsi Jun 30 10:31:38.548779 dv-cinder-822822-2-iscsi devstack@n-api.service[109677]: machine: x86_64 Jun 30 10:31:38.548779 dv-cinder-822822-2-iscsi devstack@n-api.service[109677]: clock source: unix Jun 30 10:31:38.548779 dv-cinder-822822-2-iscsi devstack@n-api.service[109677]: pcre jit disabled Jun 30 10:31:38.548779 dv-cinder-822822-2-iscsi devstack@n-api.service[109677]: detected number of CPU cores: 4 Jun 30 10:31:38.548779 dv-cinder-822822-2-iscsi devstack@n-api.service[109677]: current working directory: / Jun 30 10:31:38.548779 dv-cinder-822822-2-iscsi devstack@n-api.service[109677]: detected binary path: /usr/bin/uwsgi-core Jun 30 10:31:38.549557 dv-cinder-822822-2-iscsi devstack@n-api.service[109677]: your processes number limit is 47680 Jun 30 10:31:38.549557 dv-cinder-822822-2-iscsi devstack@n-api.service[109677]: your memory page size is 4096 bytes Jun 30 10:31:38.549557 dv-cinder-822822-2-iscsi devstack@n-api.service[109677]: detected max file descriptor number: 2048 Jun 30 10:31:38.549557 dv-cinder-822822-2-iscsi devstack@n-api.service[109677]: lock engine: pthread robust mutexes Jun 30 10:31:38.549557 dv-cinder-822822-2-iscsi devstack@n-api.service[109677]: thunder lock: enabled Jun 30 10:31:38.549557 dv-cinder-822822-2-iscsi devstack@n-api.service[109677]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 30 10:31:38.549557 dv-cinder-822822-2-iscsi devstack@n-api.service[109677]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 30 10:31:38.592171 dv-cinder-822822-2-iscsi devstack@n-api.service[109677]: Python main interpreter initialized at 0x559765e639c0 Jun 30 10:31:38.592171 dv-cinder-822822-2-iscsi devstack@n-api.service[109677]: python threads support enabled Jun 30 10:31:38.592171 dv-cinder-822822-2-iscsi devstack@n-api.service[109677]: your server socket listen backlog is limited to 100 connections Jun 30 10:31:38.592171 dv-cinder-822822-2-iscsi devstack@n-api.service[109677]: your mercy for graceful operations on workers is 90 seconds Jun 30 10:31:38.592527 dv-cinder-822822-2-iscsi devstack@n-api.service[109677]: mapped 403077 bytes (393 KB) for 2 cores Jun 30 10:31:38.592606 dv-cinder-822822-2-iscsi devstack@n-api.service[109677]: *** Operational MODE: preforking *** Jun 30 10:31:38.592837 dv-cinder-822822-2-iscsi devstack@n-api.service[109677]: *** uWSGI is running in multiple interpreter mode *** Jun 30 10:31:38.592837 dv-cinder-822822-2-iscsi devstack@n-api.service[109677]: spawned uWSGI master process (pid: 109677) Jun 30 10:31:38.593011 dv-cinder-822822-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 30 10:31:38.593757 dv-cinder-822822-2-iscsi devstack@n-api.service[109677]: spawned uWSGI worker 1 (pid: 109678, cores: 1) Jun 30 10:31:38.593946 dv-cinder-822822-2-iscsi devstack@n-api.service[109677]: spawned uWSGI worker 2 (pid: 109679, cores: 1) Jun 30 10:31:38.596536 dv-cinder-822822-2-iscsi devstack@n-api.service[109677]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 30 10:31:39.254389 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 30 10:31:39.302576 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 30 10:31:40.381264 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 10:31:40.381264 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: from cryptography.utils import int_from_bytes Jun 30 10:31:40.382615 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 10:31:40.382615 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: from cryptography.utils import int_from_bytes Jun 30 10:31:40.412918 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 10:31:40.412918 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: from cryptography.utils import int_from_bytes Jun 30 10:31:40.413403 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 10:31:40.413403 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: from cryptography.utils import int_from_bytes Jun 30 10:31:42.874448 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 30 10:31:42.875024 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 30 10:31:42.875127 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 30 10:31:42.875127 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 30 10:31:42.875552 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 30 10:31:42.875552 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 30 10:31:42.875713 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 30 10:31:42.875805 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 30 10:31:42.875960 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 30 10:31:42.876184 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.876272 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 30 10:31:42.876520 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.876669 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.876865 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.876973 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.877195 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.877290 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.877533 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.877628 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.877850 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.877943 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.878174 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.878269 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.878499 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.878584 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.878824 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.878908 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.879083 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.879180 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.879404 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.879496 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.879722 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.879811 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-822822-2-iscsi {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.880048 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.880152 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-822822-2-iscsi {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.880358 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.880443 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.880697 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.880788 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.881013 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.881108 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.881319 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.881409 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.881632 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.881727 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.881940 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.882032 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.882257 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.882436 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.882797 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.882932 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.883114 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.883209 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.883426 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.883518 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.883741 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.883843 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.884082 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.884185 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.884399 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.884484 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.884741 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.884841 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.885065 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.885156 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.885375 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.885465 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.885692 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.885789 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.886004 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.886110 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-822822-2-iscsi {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.886395 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.886481 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-822822-2-iscsi {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.886710 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.886809 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.887022 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.887117 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.887340 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.887426 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.887739 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.887841 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.888054 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.888141 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.888369 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.888455 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.888723 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.888829 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.889036 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.889130 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.889348 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.889433 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.889678 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.889766 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.890002 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.890091 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.890323 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.890408 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.890628 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.890743 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.890940 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.891028 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.891248 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.891376 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.891563 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.891658 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.891865 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.891951 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.892173 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.892268 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.892428 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.892551 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.892742 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.892838 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.893055 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.893150 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.893382 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.893472 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.893704 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.893788 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.893956 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.894053 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.894208 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.894294 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.894509 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.894606 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.894831 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.894924 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.895138 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.895223 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.895449 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.895618 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.895758 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.895849 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.896063 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.896147 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.896371 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.896463 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.896701 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.896835 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.897009 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.897093 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.897314 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.897408 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.897621 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.897706 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.897938 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.898032 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.898273 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.898360 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.898588 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.898678 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.898901 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.898985 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.899226 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.899325 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.59 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.899539 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.59 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.899624 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.59 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.899851 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.899942 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.59 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.900166 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.900251 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.900526 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.900624 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.900836 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.900929 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.901150 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.901236 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.901474 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.901558 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.901788 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.901883 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.902098 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.902182 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.902405 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.902497 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.902713 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.902804 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.903038 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.903134 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.903348 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.903433 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.903605 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.903699 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.903908 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.903992 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.904214 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.904320 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.904544 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.904654 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.904859 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.904946 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.905169 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.905254 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.905479 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.905564 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.905786 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.905871 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.906089 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.906171 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.906398 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.906492 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.906708 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.906792 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.907022 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.907113 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.907332 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.907416 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.907637 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.907720 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.907942 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.908032 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.908251 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.908336 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.908580 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.908668 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.908894 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.908981 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.909214 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.909298 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.909528 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.909613 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.909837 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.909934 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.910150 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.910266 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.910458 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.910558 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.910770 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.910872 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.911079 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.911176 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.911389 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.911484 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.911698 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.911793 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.912011 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.912098 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.912318 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.912404 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.912656 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.912756 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.912984 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.913069 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.913279 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.913383 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.913585 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.913685 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.914405 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.914505 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.914722 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.914817 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.915043 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.915141 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.915357 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.915456 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.915669 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.915756 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.915977 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.916072 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.916283 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.916369 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.916613 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.916703 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.916923 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.917037 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.917236 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.917336 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.917538 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.917623 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.917841 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.917929 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.918143 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.918229 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.918464 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.918550 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.918776 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.918862 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.919086 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.919171 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.919391 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.919476 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.919699 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.919791 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.920025 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:42.920111 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.920361 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.920455 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.920722 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.920810 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.921047 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.921191 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.921378 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.921474 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.921712 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.921805 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.922038 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.922132 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.922356 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.922451 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.922675 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.922795 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.922998 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.923100 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.923316 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.923492 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.923632 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.923718 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.923947 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.924032 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.924266 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.924352 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.924611 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.924699 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.924935 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.925030 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.925254 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.925347 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.925577 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.925670 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.925894 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.925978 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.926207 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.926289 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.926525 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.926616 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.926851 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.926943 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.927178 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.927265 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.927495 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.927594 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.927807 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.927891 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.928156 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.928250 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.928477 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.928618 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.928832 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.928935 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.929160 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.929246 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.929478 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.930181 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.930367 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.930465 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.930671 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.930757 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.930999 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.931084 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.931323 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.931428 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.931645 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.931729 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.931967 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.932052 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.932282 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.932379 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.932621 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.932709 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.932938 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.933026 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.933257 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.933415 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.933572 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.933656 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.933885 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.933969 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.934221 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.934313 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.934537 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.934622 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.934853 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.934944 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.935168 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.935253 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.935483 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.935574 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.935800 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.935884 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.936114 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.936200 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.936427 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.936550 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.936761 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.936846 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.937074 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.937168 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.937388 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.937525 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.937699 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.937790 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.938004 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.938089 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.938330 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.938422 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.938637 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.938729 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.938959 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.939052 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.939269 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.939354 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.939586 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.939679 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.939899 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.939984 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.940210 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.940295 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.940541 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.940673 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.940855 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.940961 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.941170 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.941274 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.941481 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.941594 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.941791 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.941896 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.942109 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.942203 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.942422 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.942517 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.942732 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.942848 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.943044 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.943140 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.943353 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.943464 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.943661 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.943761 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.943972 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.944069 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.944287 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.944372 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.944630 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.944719 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.944947 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.945033 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.945291 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.945376 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.945620 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.945714 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.945935 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.946028 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.946253 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.946337 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.946593 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.946679 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.946899 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.947064 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.947226 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.947310 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.947553 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.947636 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.947875 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.947973 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.948185 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.948271 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.948492 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.948623 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.948825 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.948925 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.949133 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.949218 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.949439 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.949530 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.949745 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.949831 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.950049 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.950132 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.950355 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.950439 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.950658 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.950743 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.950964 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.951047 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.951267 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.951349 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.951573 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.951669 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.951893 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.951978 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.952203 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.952286 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.952530 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.952617 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.952837 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.952923 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.953145 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.953245 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.953478 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.953563 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.953792 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.953875 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.954140 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.954235 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.954459 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.954542 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.954787 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.954872 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.955105 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.955198 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.955422 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.955506 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.955734 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.955818 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.956048 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.956146 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.956362 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.956446 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.956703 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.956788 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.957024 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.957112 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.957338 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.957422 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.957657 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.957748 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.957967 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.958052 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.958287 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.958379 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.958601 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.958685 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.958917 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.959002 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.959224 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.959309 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.959542 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.959632 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.959864 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.959950 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.960202 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.960286 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.960545 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.960644 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.960896 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.960987 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.961211 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.961302 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.961529 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.961680 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.961840 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.961935 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.962151 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.962241 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.962462 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.962555 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.962775 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.962860 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.963094 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.963179 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.963405 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.963498 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.963727 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.963808 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.964041 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.964146 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.964356 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.964450 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.964696 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.964784 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.965015 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.965099 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.965321 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.965406 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.965636 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.965728 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.965957 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.966049 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.966290 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.966377 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.966601 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.966684 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.966918 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.967010 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.967233 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.967317 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.967553 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.967645 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.967866 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.967958 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.968177 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.968262 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.968488 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.968605 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.968819 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.968914 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.969125 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.969210 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.969442 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.969528 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.969753 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.969844 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.970064 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.970148 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.970371 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.970456 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.970679 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.970771 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.970988 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.971071 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.971298 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.971391 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.971604 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.971696 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.971912 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.972073 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.972215 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.972348 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.972557 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.972658 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.972882 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.972967 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.973205 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.973290 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.973518 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.973605 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.973826 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.973919 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.974139 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.974273 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.974453 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.974594 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.974766 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.974902 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.975072 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.975223 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.975380 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.975722 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.975948 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.976033 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.976295 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.976888 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.977151 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.977239 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.977460 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.977545 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.977786 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.977920 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.978101 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.978185 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.978413 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.978497 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.978728 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.978821 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.979042 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.979126 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.979357 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.979442 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.979676 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.979774 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.979991 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.980075 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.980306 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.980390 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.980644 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.980744 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.980962 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.981047 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.981275 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.981359 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.981593 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.981680 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.981906 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.981998 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.982223 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.982309 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.982537 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.982622 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.982850 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.982935 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.983162 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.983254 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.983480 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.983582 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.983810 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.984045 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.984374 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.984460 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.984723 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.984809 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.985050 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.985136 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.985373 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.985466 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.985695 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.985786 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.986018 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.986110 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.986351 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.986444 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.986684 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.986775 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.987003 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.987095 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.987320 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.987413 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.987637 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.987721 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.987945 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.988029 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.988254 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.988338 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.988587 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.988693 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.988899 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.988991 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.989207 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.989292 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.989515 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.989613 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.989820 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.989918 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.990126 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.990211 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.990433 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.990525 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.990740 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.990832 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.991051 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.991137 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.991355 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.991453 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.991666 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.991751 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.991971 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.992657 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.992845 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.992932 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.993163 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.993247 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.993473 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.993562 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.993782 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.993869 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.994090 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.994223 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.994402 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.994495 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.994730 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.994815 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.995046 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.995131 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.995387 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.995472 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.995721 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.995816 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.996029 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.996113 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.996339 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.996432 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.996690 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.996831 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.996996 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.997082 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.997306 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.997401 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.997612 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.997704 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.997923 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.998008 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.998232 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.998340 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.998539 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.998631 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.998842 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.998926 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.999154 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.999246 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.999464 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.999549 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.999774 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:42.999857 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.000082 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.000169 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.000385 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.000469 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.000725 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.000813 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.001034 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.001121 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.001348 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.001431 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.001655 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.001747 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.001961 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.002100 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.002270 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.002362 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.002582 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.002668 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.002884 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.002970 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.003192 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.003277 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.003495 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.003589 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.003810 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.003895 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.004114 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.004205 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.004424 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.004547 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.004755 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.004861 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.005063 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.005149 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.005373 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.005467 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.005682 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.005767 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.005984 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.006069 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.006313 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.006407 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.006623 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.006709 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.006929 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.007013 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.007238 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.007324 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.007549 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.007661 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.007882 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.007967 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.008197 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.008283 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.008541 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.008631 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.008866 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.008953 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.009174 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.009261 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.009487 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.009584 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.009799 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.009884 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.010109 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.010212 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.010418 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.010503 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.010726 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.010824 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.011029 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.011114 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.011335 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.011421 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.011643 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.011737 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.011948 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.012032 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.012255 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.012341 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.012590 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.012691 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.012908 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.012994 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.013218 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.013304 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.013526 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.013621 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.013837 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.013939 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.014143 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.014235 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.014477 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.014570 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.014791 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.014885 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.015133 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.015216 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.015451 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.015545 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.015771 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.015863 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.016085 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.016169 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.016402 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.016487 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.016744 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.016839 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.017054 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.017140 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.017360 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.017445 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.017680 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.017764 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.017994 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.018087 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.018301 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.018384 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.018610 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.018695 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.018917 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.019017 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.019237 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.019323 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.019553 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.019640 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.019868 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.019961 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.020192 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.020276 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.020555 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.020644 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.020848 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.020949 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.021162 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.021256 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.021474 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.021568 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.021784 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.021876 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.022096 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.022182 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.022404 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.022489 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.022717 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.022802 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.023029 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.023120 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.023869 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.023963 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.024187 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.024273 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.024515 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.024613 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.024830 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.024916 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.025141 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.025226 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.025453 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.025537 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.025762 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.025847 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.026070 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.026155 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.026392 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.026475 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.026700 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.026793 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.027007 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.027131 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.027314 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.027401 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.027622 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.027721 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.027926 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.028010 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.028231 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.028363 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.028702 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.028806 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.029017 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.029101 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.029329 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.029414 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.029637 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.029722 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.029947 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.030030 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.030259 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.030350 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.030576 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.030661 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.030887 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.030979 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.031193 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.031307 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.031615 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.031703 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.031930 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.032022 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.032245 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.032354 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.032580 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.032672 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.032891 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.032978 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.033198 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.033282 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.033517 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.033611 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.033826 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.033948 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.034137 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.034231 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.034448 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.034541 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.034756 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.034849 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.035073 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.035171 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.035384 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.035470 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.035742 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.035836 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.036113 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.036219 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.036425 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.036537 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.036763 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.036857 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.037172 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.037303 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.037487 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.037573 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.037803 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.037888 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.038134 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.038220 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.038460 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.038594 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.038767 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.038869 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.039632 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.039730 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.039953 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.040040 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.040273 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.040358 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.040623 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.040712 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.040947 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.041036 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.041263 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.041348 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.041571 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.041654 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.041884 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.041970 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.042213 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.042297 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.042529 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.042699 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.042847 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.042932 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.043177 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.043262 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.043576 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.043669 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.043894 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.043980 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.044218 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.044312 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.044562 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.044662 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.044878 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.044973 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.045189 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.045276 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.045497 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.045590 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.045815 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.045901 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.046128 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.046214 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.046441 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.046528 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.046769 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.046857 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.047081 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.047166 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.047400 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.047487 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.047719 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.047805 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.048035 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.048121 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.048345 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.048464 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.048683 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.048840 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.049013 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.049154 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.049324 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.049484 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.049654 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.049806 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.049974 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.050135 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.050302 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.050503 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.050632 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.050858 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.050944 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.051200 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.051287 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.051516 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.051602 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.051828 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.051914 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.052139 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.052233 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.052445 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.052595 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.052820 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.052906 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.053129 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.053214 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.053453 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.053538 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.053785 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.053877 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.054114 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.054200 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.054433 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.054537 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.054795 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.054889 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.055122 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.055213 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.055443 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.055528 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.055763 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.055856 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.056087 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.056179 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.056393 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.056484 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.056729 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.056834 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.057041 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.057126 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.057347 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.057476 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.057652 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.057747 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.057959 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.058052 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.058266 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.058351 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.058573 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.058659 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.058876 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.058968 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.059178 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.059262 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.059501 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.059586 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.059807 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.059899 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.060132 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.060217 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.060441 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.060559 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.060780 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.060866 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.061090 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.061190 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.061398 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.061484 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.061743 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.061829 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.062051 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.062146 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.062384 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.062470 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.062704 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.062789 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.063029 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.063127 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.063360 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.063452 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.063672 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.063763 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.063999 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.064092 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.064323 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.064410 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.064669 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.064758 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.064991 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.065078 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.065310 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.065394 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.065627 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.065711 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.065946 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.066038 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.066264 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.066348 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.066574 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.066658 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.066893 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.066979 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.067211 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.067296 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.067529 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.067615 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.068044 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.068137 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.068374 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.068458 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.068716 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.068870 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.069030 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.069121 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.069344 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.069436 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.069661 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.069754 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.069974 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.070058 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.070316 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.070402 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.070633 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.070726 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.070946 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.071038 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.071258 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.071344 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.071586 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.071671 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.071909 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.071995 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.072238 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.072331 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.072597 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.072698 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.072920 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.073005 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.073239 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.073336 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.073555 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.073642 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.073872 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.073957 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.074228 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.074325 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.074548 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.074649 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.074854 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.074939 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.075172 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.075270 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.075487 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.075588 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.075804 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.075890 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.076117 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.076203 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.076432 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.076562 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.076779 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.076863 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.077095 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.077184 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.077408 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.077493 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.077720 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.077805 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.078039 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.078133 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.078353 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.078438 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.078680 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.078779 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.079017 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.079109 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.079340 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.079424 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.079654 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.079753 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.079969 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.080054 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.080285 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.080370 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.080841 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.080944 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.081160 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.081245 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.081498 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.081591 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.081830 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.081923 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.082157 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.082247 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.082478 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.082562 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.082797 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.082883 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.083126 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.083210 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.083435 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.083519 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.083745 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.083837 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.084067 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.084171 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.084369 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.084537 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.084704 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.084791 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.085030 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.085114 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.085346 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.085449 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.085653 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.086251 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.086503 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.086588 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.086817 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.086911 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.087352 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.087439 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.087701 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.087838 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.088021 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.088115 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.088354 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.088446 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.088711 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.088810 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.089032 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.089130 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.089343 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.089428 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.089668 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.089760 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.089978 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.090064 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.090290 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.090377 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.090614 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.090700 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.090931 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.091017 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.091238 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.091323 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.091544 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.091629 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.091857 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.091949 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.092168 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.092253 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.092474 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.092577 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.092813 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.092900 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.093120 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.093214 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.093454 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.093552 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.093761 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.093846 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.094070 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.094156 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.094377 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.094471 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.094697 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.094800 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.095003 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.095090 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.095307 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.095400 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.095615 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.095700 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.095918 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.096003 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.096232 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.096326 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.096558 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.096647 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.096873 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.096961 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.097179 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.097274 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.097494 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.097579 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.097798 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.097926 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.098109 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.098202 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.098455 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.098540 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.098782 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.098868 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.099089 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.099213 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.099394 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.099480 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.099712 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.099798 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.100026 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.100111 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.100350 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.100442 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.100956 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.101052 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.101276 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.101388 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.102182 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.102289 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.102507 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.102603 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.103044 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.103133 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.103386 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.103472 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.103716 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.103891 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.104058 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.104144 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.104399 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.104485 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.104747 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.104867 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.105063 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.105182 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.105377 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.105514 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.105709 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.105847 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.106029 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.106168 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.106348 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.106492 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.106667 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.106843 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.106988 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.107164 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.107305 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.107482 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.107624 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.107797 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.107940 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.108121 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.108259 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.108438 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.108597 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.108782 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.108915 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.109100 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.109233 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.109416 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.109551 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.109729 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.109867 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.110043 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.110189 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.110363 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.110535 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.110706 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.110861 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.111032 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.111188 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.111357 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.111512 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.111680 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.111838 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.112004 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.112157 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.112320 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.112476 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.112663 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.112818 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.112979 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.113136 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.113295 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.113461 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.113616 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.113798 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.113949 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.114122 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.114267 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.114437 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.114578 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.114866 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.115001 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.115187 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.115321 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.115513 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.115643 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.115844 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.115969 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.116166 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.116285 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.116497 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.116638 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.116855 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.116962 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.117202 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.117290 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.117532 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.117618 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.117851 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.117938 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.118189 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.118283 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.118537 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.118623 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.118875 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.118961 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.119205 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.119289 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.119515 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.119603 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.119823 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.119910 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.120132 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.120217 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.120444 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.120559 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.120794 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.120880 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.121104 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.121189 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.121412 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.121510 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.121719 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.121805 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.122032 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.122117 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.122339 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.122432 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.122674 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.122765 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.122955 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.123040 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.123263 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.123357 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.123575 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.123667 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.123881 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.123966 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.124185 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.124273 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.124592 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.124687 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.124822 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.124954 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.125129 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.125216 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.125431 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.125515 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.125744 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.125845 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.126048 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.126133 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.126444 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.126568 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.126674 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.126760 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.126945 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.127032 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.127251 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.127335 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.127583 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.127684 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.127920 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.128013 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.128286 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.128387 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.128600 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.128703 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.128922 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.129009 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.129253 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.129339 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.129570 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.129664 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.129897 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.129983 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.130226 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.130320 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.130545 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.130640 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.130861 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.130948 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.131200 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.131286 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.131518 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.131605 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.131839 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.131925 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.132159 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.132245 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.132476 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.132586 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.132840 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.132926 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.133156 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.133253 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.133486 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.133573 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.133816 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.133901 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.134124 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.134222 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.134454 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.134547 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.134776 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.134860 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.135101 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.135202 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.135420 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.135505 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.135737 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.135821 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.136069 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.136162 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.136387 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.136473 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.136726 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.136812 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.137047 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.137133 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.137360 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.137453 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.137675 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.137768 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.137999 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.138085 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.138325 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.138445 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.138654 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.138755 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.138984 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.139081 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.139297 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.139393 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.139627 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.139738 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.139956 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.140053 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.140371 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.140474 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.140653 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.140769 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.141002 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.141088 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.141333 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.141418 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.141651 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.141754 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.141965 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.142051 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.142274 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.142365 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:43.142520 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 30 10:31:43.142619 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 30 10:31:43.297701 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: INFO dbcounter [None req-ec8bd87e-06fd-4e83-a83b-2a230d7f4258 None None] Registered counter for database nova_api Jun 30 10:31:43.299492 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: INFO dbcounter [None req-ac30344c-e8c5-441d-b8ef-23f841234784 None None] Registered counter for database nova_api Jun 30 10:31:43.319342 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG oslo_db.sqlalchemy.engines [None req-ec8bd87e-06fd-4e83-a83b-2a230d7f4258 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109678) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 10:31:43.320929 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG oslo_db.sqlalchemy.engines [None req-ac30344c-e8c5-441d-b8ef-23f841234784 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109679) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 10:31:43.326118 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG dbcounter [-] [109678] Writer thread running {{(pid=109678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 10:31:43.327447 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG dbcounter [-] [109679] Writer thread running {{(pid=109679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 10:31:43.381463 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.context [None req-ec8bd87e-06fd-4e83-a83b-2a230d7f4258 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),426e332d-fd0b-425e-9da3-ae65045e8059(cell1) {{(pid=109678) load_cells /opt/stack/nova/nova/context.py:464}} Jun 30 10:31:43.384397 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.context [None req-ac30344c-e8c5-441d-b8ef-23f841234784 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),426e332d-fd0b-425e-9da3-ae65045e8059(cell1) {{(pid=109679) load_cells /opt/stack/nova/nova/context.py:464}} Jun 30 10:31:43.385908 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG oslo_concurrency.lockutils [None req-ec8bd87e-06fd-4e83-a83b-2a230d7f4258 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:31:43.387483 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG oslo_concurrency.lockutils [None req-ec8bd87e-06fd-4e83-a83b-2a230d7f4258 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:31:43.388260 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG oslo_concurrency.lockutils [None req-ec8bd87e-06fd-4e83-a83b-2a230d7f4258 None None] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:31:43.388389 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG oslo_concurrency.lockutils [None req-ac30344c-e8c5-441d-b8ef-23f841234784 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:31:43.390006 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG oslo_concurrency.lockutils [None req-ac30344c-e8c5-441d-b8ef-23f841234784 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:31:43.390202 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG oslo_concurrency.lockutils [None req-ec8bd87e-06fd-4e83-a83b-2a230d7f4258 None None] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:31:43.390812 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG oslo_concurrency.lockutils [None req-ac30344c-e8c5-441d-b8ef-23f841234784 None None] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:31:43.392162 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: INFO dbcounter [None req-ec8bd87e-06fd-4e83-a83b-2a230d7f4258 None None] Registered counter for database nova_cell0 Jun 30 10:31:43.392799 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG oslo_concurrency.lockutils [None req-ac30344c-e8c5-441d-b8ef-23f841234784 None None] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:31:43.394832 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: INFO dbcounter [None req-ac30344c-e8c5-441d-b8ef-23f841234784 None None] Registered counter for database nova_cell0 Jun 30 10:31:43.397509 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: INFO dbcounter [None req-ec8bd87e-06fd-4e83-a83b-2a230d7f4258 None None] Registered counter for database nova_cell1 Jun 30 10:31:43.400779 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: INFO dbcounter [None req-ac30344c-e8c5-441d-b8ef-23f841234784 None None] Registered counter for database nova_cell1 Jun 30 10:31:43.405179 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG oslo_db.sqlalchemy.engines [None req-ec8bd87e-06fd-4e83-a83b-2a230d7f4258 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109678) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 10:31:43.407738 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG oslo_db.sqlalchemy.engines [None req-ec8bd87e-06fd-4e83-a83b-2a230d7f4258 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109678) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 10:31:43.409187 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG oslo_db.sqlalchemy.engines [None req-ac30344c-e8c5-441d-b8ef-23f841234784 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109679) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 10:31:43.410711 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG dbcounter [-] [109678] Writer thread running {{(pid=109678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 10:31:43.412578 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG oslo_db.sqlalchemy.engines [None req-ac30344c-e8c5-441d-b8ef-23f841234784 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109679) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 10:31:43.415610 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG dbcounter [-] [109679] Writer thread running {{(pid=109679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 10:31:43.547580 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG dbcounter [-] [109678] Writer thread running {{(pid=109678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 10:31:43.552467 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG dbcounter [-] [109679] Writer thread running {{(pid=109679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 10:31:43.556451 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: INFO dbcounter [None req-ec8bd87e-06fd-4e83-a83b-2a230d7f4258 None None] Registered counter for database nova_cell0 Jun 30 10:31:43.561636 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: INFO dbcounter [None req-ac30344c-e8c5-441d-b8ef-23f841234784 None None] Registered counter for database nova_cell0 Jun 30 10:31:43.565264 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG oslo_db.sqlalchemy.engines [None req-ec8bd87e-06fd-4e83-a83b-2a230d7f4258 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109678) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 10:31:43.569741 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG dbcounter [-] [109678] Writer thread running {{(pid=109678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 10:31:43.570738 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG oslo_db.sqlalchemy.engines [None req-ac30344c-e8c5-441d-b8ef-23f841234784 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109679) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 10:31:43.575152 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG dbcounter [-] [109679] Writer thread running {{(pid=109679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 10:31:43.908858 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: WARNING keystonemiddleware.auth_token [None req-ac30344c-e8c5-441d-b8ef-23f841234784 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 30 10:31:43.910463 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: WARNING keystonemiddleware.auth_token [None req-ec8bd87e-06fd-4e83-a83b-2a230d7f4258 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 30 10:31:43.916106 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: WARNING keystonemiddleware.auth_token [None req-ac30344c-e8c5-441d-b8ef-23f841234784 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 30 10:31:43.917686 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: WARNING keystonemiddleware.auth_token [None req-ec8bd87e-06fd-4e83-a83b-2a230d7f4258 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 30 10:31:44.261471 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: WARNING keystonemiddleware.auth_token [None req-ac30344c-e8c5-441d-b8ef-23f841234784 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 30 10:31:44.267421 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: WARNING keystonemiddleware.auth_token [None req-ac30344c-e8c5-441d-b8ef-23f841234784 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 30 10:31:44.269120 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: WARNING keystonemiddleware.auth_token [None req-ec8bd87e-06fd-4e83-a83b-2a230d7f4258 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 30 10:31:44.272809 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559765e639c0 pid: 109679 (default app) Jun 30 10:31:44.274901 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi [None req-ac30344c-e8c5-441d-b8ef-23f841234784 None None] Calling method '>' {{(pid=109679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:31:44.275671 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: WARNING keystonemiddleware.auth_token [None req-ec8bd87e-06fd-4e83-a83b-2a230d7f4258 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 30 10:31:44.276083 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: INFO nova.api.openstack.requestlog [None req-ac30344c-e8c5-441d-b8ef-23f841234784 None None] 10.222.0.59 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001745 Jun 30 10:31:44.276493 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: [pid: 109679|app: 0|req: 1/1] 10.222.0.59 () {50 vars in 788 bytes} [Thu Jun 30 10:31:44 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:31:44.281418 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559765e639c0 pid: 109678 (default app) Jun 30 10:32:58.659718 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi [None req-ac30344c-e8c5-441d-b8ef-23f841234784 None None] Calling method '>' {{(pid=109679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:32:58.660828 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: INFO nova.api.openstack.requestlog [None req-ac30344c-e8c5-441d-b8ef-23f841234784 None None] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Jun 30 10:32:58.661218 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: [pid: 109679|app: 0|req: 2/2] 10.222.0.59 () {54 vars in 930 bytes} [Thu Jun 30 10:32:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:32:58.673960 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG dbcounter [-] [109678] Writing DB stats nova_api:SELECT=3 {{(pid=109678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:58.674876 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG dbcounter [-] [109678] Writing DB stats nova_cell1:SELECT=3 {{(pid=109678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:58.676078 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG dbcounter [-] [109678] Writing DB stats nova_cell0:SELECT=3 {{(pid=109678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:58.676835 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG dbcounter [-] [109678] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=109678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:59.108363 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi [None req-d14fb79d-063f-4157-974d-30e896bf6668 admin admin] Calling method '>' {{(pid=109678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:32:59.138744 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: INFO nova.api.openstack.requestlog [None req-d14fb79d-063f-4157-974d-30e896bf6668 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.469953 Jun 30 10:32:59.139523 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: [pid: 109678|app: 0|req: 1/3] 10.222.0.59 () {60 vars in 1291 bytes} [Thu Jun 30 10:32:58 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:33:01.188436 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi [None req-ac30344c-e8c5-441d-b8ef-23f841234784 None None] Calling method '>' {{(pid=109679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:33:01.189464 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: INFO nova.api.openstack.requestlog [None req-ac30344c-e8c5-441d-b8ef-23f841234784 None None] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Jun 30 10:33:01.190016 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: [pid: 109679|app: 0|req: 3/4] 10.222.0.59 () {54 vars in 930 bytes} [Thu Jun 30 10:33:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:33:01.253808 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi [None req-2cf4ab4b-e996-4b40-89c0-575a516dad7f admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "disk": 1, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "c1", "name": "cirros256"}} {{(pid=109678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:33:01.272651 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 10:33:01.272651 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: warnings.warn(msg) Jun 30 10:33:01.303775 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: INFO nova.api.openstack.requestlog [None req-2cf4ab4b-e996-4b40-89c0-575a516dad7f admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.107629 Jun 30 10:33:01.305078 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: [pid: 109678|app: 0|req: 2/5] 10.222.0.59 () {64 vars in 1282 bytes} [Thu Jun 30 10:33:01 2022] POST /compute/v2.1/flavors => generated 407 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 10:33:01.318849 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG dbcounter [-] [109679] Writing DB stats nova_api:SELECT=3 {{(pid=109679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:01.320151 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG dbcounter [-] [109679] Writing DB stats nova_cell0:SELECT=3 {{(pid=109679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:01.323600 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG dbcounter [-] [109679] Writing DB stats nova_cell1:SELECT=3 {{(pid=109679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:01.324325 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG dbcounter [-] [109679] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=109679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:01.532367 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi [None req-cdaaad8c-9a2b-4cf4-8ac3-359b636d3a9d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:33:01.534809 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 10:33:01.534809 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: warnings.warn(msg) Jun 30 10:33:01.595659 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: INFO nova.api.openstack.requestlog [None req-cdaaad8c-9a2b-4cf4-8ac3-359b636d3a9d admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.282712 Jun 30 10:33:01.596530 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: [pid: 109679|app: 0|req: 4/6] 10.222.0.59 () {64 vars in 1335 bytes} [Thu Jun 30 10:33:01 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:33:03.711272 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi [None req-2cf4ab4b-e996-4b40-89c0-575a516dad7f admin admin] Calling method '>' {{(pid=109678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:33:03.712296 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: INFO nova.api.openstack.requestlog [None req-2cf4ab4b-e996-4b40-89c0-575a516dad7f admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jun 30 10:33:03.712728 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: [pid: 109678|app: 0|req: 3/7] 10.222.0.59 () {54 vars in 930 bytes} [Thu Jun 30 10:33:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:33:03.816157 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi [None req-aa69d30d-ab05-4f41-88c7-474797ef9f85 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "ram": 512, "id": "d1", "disk": 5, "name": "ds512M"}} {{(pid=109679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:33:03.835509 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 10:33:03.835509 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: warnings.warn(msg) Jun 30 10:33:03.853586 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: INFO nova.api.openstack.requestlog [None req-aa69d30d-ab05-4f41-88c7-474797ef9f85 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.135156 Jun 30 10:33:03.854134 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: [pid: 109679|app: 0|req: 5/8] 10.222.0.59 () {64 vars in 1282 bytes} [Thu Jun 30 10:33:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 10:33:03.866109 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi [None req-39e2e082-a790-4983-8b09-c6785c365549 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:33:03.867527 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 10:33:03.867527 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: warnings.warn(msg) Jun 30 10:33:03.901095 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: INFO nova.api.openstack.requestlog [None req-39e2e082-a790-4983-8b09-c6785c365549 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038826 Jun 30 10:33:03.901680 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: [pid: 109678|app: 0|req: 4/9] 10.222.0.59 () {64 vars in 1335 bytes} [Thu Jun 30 10:33:03 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:33:05.970735 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi [None req-aa69d30d-ab05-4f41-88c7-474797ef9f85 admin admin] Calling method '>' {{(pid=109679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:33:05.972250 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: INFO nova.api.openstack.requestlog [None req-aa69d30d-ab05-4f41-88c7-474797ef9f85 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001909 Jun 30 10:33:05.972902 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: [pid: 109679|app: 0|req: 6/10] 10.222.0.59 () {54 vars in 930 bytes} [Thu Jun 30 10:33:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:33:06.034800 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi [None req-0bca3df8-b6e1-4e25-8d3e-932deff25cdc admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d2", "os-flavor-access:is_public": true, "disk": 10, "name": "ds1G", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 1024}} {{(pid=109678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:33:06.056165 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: INFO nova.api.openstack.requestlog [None req-0bca3df8-b6e1-4e25-8d3e-932deff25cdc admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076688 Jun 30 10:33:06.056813 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: [pid: 109678|app: 0|req: 5/11] 10.222.0.59 () {64 vars in 1282 bytes} [Thu Jun 30 10:33:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 10:33:06.070487 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi [None req-6786e24e-2164-43c7-a815-0c7e8e1d1fba admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:33:06.110591 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: INFO nova.api.openstack.requestlog [None req-6786e24e-2164-43c7-a815-0c7e8e1d1fba admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045751 Jun 30 10:33:06.111314 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: [pid: 109679|app: 0|req: 7/12] 10.222.0.59 () {64 vars in 1335 bytes} [Thu Jun 30 10:33:06 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:33:08.180920 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi [None req-0bca3df8-b6e1-4e25-8d3e-932deff25cdc admin admin] Calling method '>' {{(pid=109678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:33:08.181938 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: INFO nova.api.openstack.requestlog [None req-0bca3df8-b6e1-4e25-8d3e-932deff25cdc admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Jun 30 10:33:08.182342 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: [pid: 109678|app: 0|req: 6/13] 10.222.0.59 () {54 vars in 930 bytes} [Thu Jun 30 10:33:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:33:08.239566 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi [None req-7d70333c-9fb5-4f81-aaf8-70f682cc5a59 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "swap": 0, "name": "ds2G", "vcpus": 2, "rxtx_factor": 1.0, "id": "d3", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10}} {{(pid=109679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:33:08.257009 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: INFO nova.api.openstack.requestlog [None req-7d70333c-9fb5-4f81-aaf8-70f682cc5a59 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.069094 Jun 30 10:33:08.257715 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: [pid: 109679|app: 0|req: 8/14] 10.222.0.59 () {64 vars in 1282 bytes} [Thu Jun 30 10:33:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 30 10:33:08.270218 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi [None req-72a984ff-eff3-427a-9a82-f1fe54ab5c55 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:33:08.292865 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: INFO nova.api.openstack.requestlog [None req-72a984ff-eff3-427a-9a82-f1fe54ab5c55 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026345 Jun 30 10:33:08.293698 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: [pid: 109678|app: 0|req: 7/15] 10.222.0.59 () {64 vars in 1335 bytes} [Thu Jun 30 10:33:08 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:33:10.385114 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi [None req-7d70333c-9fb5-4f81-aaf8-70f682cc5a59 admin admin] Calling method '>' {{(pid=109679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:33:10.386134 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: INFO nova.api.openstack.requestlog [None req-7d70333c-9fb5-4f81-aaf8-70f682cc5a59 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 Jun 30 10:33:10.386528 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: [pid: 109679|app: 0|req: 9/16] 10.222.0.59 () {54 vars in 930 bytes} [Thu Jun 30 10:33:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:33:10.447510 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi [None req-92ae6cef-5720-4338-95ac-18f631b7cdb4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "rxtx_factor": 1.0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "name": "ds4G", "vcpus": 4, "disk": 20}} {{(pid=109678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:33:10.464735 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: INFO nova.api.openstack.requestlog [None req-92ae6cef-5720-4338-95ac-18f631b7cdb4 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.072420 Jun 30 10:33:10.465306 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: [pid: 109678|app: 0|req: 8/17] 10.222.0.59 () {64 vars in 1282 bytes} [Thu Jun 30 10:33:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 10:33:10.477368 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi [None req-82842476-a5ea-4841-838e-dc98829e2805 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:33:10.499070 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: INFO nova.api.openstack.requestlog [None req-82842476-a5ea-4841-838e-dc98829e2805 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025706 Jun 30 10:33:10.499617 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: [pid: 109679|app: 0|req: 10/18] 10.222.0.59 () {64 vars in 1335 bytes} [Thu Jun 30 10:33:10 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:33:12.590475 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi [None req-92ae6cef-5720-4338-95ac-18f631b7cdb4 admin admin] Calling method '>' {{(pid=109678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:33:12.591497 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: INFO nova.api.openstack.requestlog [None req-92ae6cef-5720-4338-95ac-18f631b7cdb4 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Jun 30 10:33:12.591899 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: [pid: 109678|app: 0|req: 9/19] 10.222.0.59 () {54 vars in 930 bytes} [Thu Jun 30 10:33:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:33:12.652548 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi [None req-e8307b57-d5ae-437e-aef7-b55aed833ece admin admin] Calling method '>' {{(pid=109679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:33:12.676522 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: INFO nova.api.openstack.requestlog [None req-e8307b57-d5ae-437e-aef7-b55aed833ece admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.078603 Jun 30 10:33:12.680557 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: [pid: 109679|app: 0|req: 11/20] 10.222.0.59 () {60 vars in 1291 bytes} [Thu Jun 30 10:33:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:33:14.765333 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi [None req-92ae6cef-5720-4338-95ac-18f631b7cdb4 admin admin] Calling method '>' {{(pid=109678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:33:14.766355 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: INFO nova.api.openstack.requestlog [None req-92ae6cef-5720-4338-95ac-18f631b7cdb4 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Jun 30 10:33:14.766756 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: [pid: 109678|app: 0|req: 10/21] 10.222.0.59 () {54 vars in 930 bytes} [Thu Jun 30 10:33:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 10:33:14.828498 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi [None req-8b77105a-2099-4aea-9a73-e37166c28b76 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "vcpus": 1, "rxtx_factor": 1.0, "name": "m1.tiny", "ram": 512, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=109679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:33:14.848434 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: INFO nova.api.openstack.requestlog [None req-8b77105a-2099-4aea-9a73-e37166c28b76 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.075866 Jun 30 10:33:14.849550 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: [pid: 109679|app: 0|req: 12/22] 10.222.0.59 () {64 vars in 1282 bytes} [Thu Jun 30 10:33:14 2022] POST /compute/v2.1/flavors => generated 402 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 10:33:14.861729 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi [None req-3bd73c1b-5f19-4235-9691-0976e75136d9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:33:14.885157 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: INFO nova.api.openstack.requestlog [None req-3bd73c1b-5f19-4235-9691-0976e75136d9 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027117 Jun 30 10:33:14.885746 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: [pid: 109678|app: 0|req: 11/23] 10.222.0.59 () {64 vars in 1332 bytes} [Thu Jun 30 10:33:14 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:33:17.504838 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi [None req-8b77105a-2099-4aea-9a73-e37166c28b76 admin admin] Calling method '>' {{(pid=109679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:33:17.506441 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: INFO nova.api.openstack.requestlog [None req-8b77105a-2099-4aea-9a73-e37166c28b76 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002062 Jun 30 10:33:17.506848 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: [pid: 109679|app: 0|req: 13/24] 10.222.0.59 () {54 vars in 930 bytes} [Thu Jun 30 10:33:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:33:17.574833 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi [None req-f3a1ccfd-0d2a-4832-b24b-c55fcf2f13cf admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "name": "m1.small", "id": "2", "os-flavor-access:is_public": true, "ram": 2048, "rxtx_factor": 1.0}} {{(pid=109678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:33:17.594193 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: INFO nova.api.openstack.requestlog [None req-f3a1ccfd-0d2a-4832-b24b-c55fcf2f13cf admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.081480 Jun 30 10:33:17.594896 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: [pid: 109678|app: 0|req: 12/25] 10.222.0.59 () {64 vars in 1282 bytes} [Thu Jun 30 10:33:17 2022] POST /compute/v2.1/flavors => generated 405 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 10:33:17.608992 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi [None req-8505fda3-19d5-4f37-8ec1-e49cf7717499 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:33:17.634631 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: INFO nova.api.openstack.requestlog [None req-8505fda3-19d5-4f37-8ec1-e49cf7717499 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029409 Jun 30 10:33:17.635204 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: [pid: 109679|app: 0|req: 14/26] 10.222.0.59 () {64 vars in 1332 bytes} [Thu Jun 30 10:33:17 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:33:19.738341 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi [None req-f3a1ccfd-0d2a-4832-b24b-c55fcf2f13cf admin admin] Calling method '>' {{(pid=109678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:33:19.739811 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: INFO nova.api.openstack.requestlog [None req-f3a1ccfd-0d2a-4832-b24b-c55fcf2f13cf admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001949 Jun 30 10:33:19.740349 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: [pid: 109678|app: 0|req: 13/27] 10.222.0.59 () {54 vars in 930 bytes} [Thu Jun 30 10:33:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:33:19.799520 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi [None req-90694b1d-6a6f-47f8-9734-5ecbb6220c67 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "ram": 4096, "id": "3", "disk": 40, "name": "m1.medium"}} {{(pid=109679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:33:19.816649 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: INFO nova.api.openstack.requestlog [None req-90694b1d-6a6f-47f8-9734-5ecbb6220c67 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.069238 Jun 30 10:33:19.817203 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: [pid: 109679|app: 0|req: 15/28] 10.222.0.59 () {64 vars in 1282 bytes} [Thu Jun 30 10:33:19 2022] POST /compute/v2.1/flavors => generated 406 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 30 10:33:19.830463 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi [None req-bf3325f1-2f1b-4599-b9b7-3d264d2331b8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:33:19.858331 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: INFO nova.api.openstack.requestlog [None req-bf3325f1-2f1b-4599-b9b7-3d264d2331b8 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032593 Jun 30 10:33:19.858905 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: [pid: 109678|app: 0|req: 14/29] 10.222.0.59 () {64 vars in 1332 bytes} [Thu Jun 30 10:33:19 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:33:21.937310 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi [None req-90694b1d-6a6f-47f8-9734-5ecbb6220c67 admin admin] Calling method '>' {{(pid=109679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:33:21.938331 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: INFO nova.api.openstack.requestlog [None req-90694b1d-6a6f-47f8-9734-5ecbb6220c67 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Jun 30 10:33:21.938877 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: [pid: 109679|app: 0|req: 16/30] 10.222.0.59 () {54 vars in 930 bytes} [Thu Jun 30 10:33:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:33:21.997119 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi [None req-624b6015-dde3-4267-b06b-8d1a2f62fed7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "vcpus": 4, "disk": 80, "id": "4", "ram": 8192, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=109678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:33:22.016731 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: INFO nova.api.openstack.requestlog [None req-624b6015-dde3-4267-b06b-8d1a2f62fed7 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.072299 Jun 30 10:33:22.017299 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: [pid: 109678|app: 0|req: 15/31] 10.222.0.59 () {64 vars in 1282 bytes} [Thu Jun 30 10:33:21 2022] POST /compute/v2.1/flavors => generated 405 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 10:33:22.030357 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi [None req-398213fd-6096-4163-ac45-7247b90c019c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:33:22.061367 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: INFO nova.api.openstack.requestlog [None req-398213fd-6096-4163-ac45-7247b90c019c admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034652 Jun 30 10:33:22.062199 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: [pid: 109679|app: 0|req: 17/32] 10.222.0.59 () {64 vars in 1332 bytes} [Thu Jun 30 10:33:22 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:33:24.141755 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi [None req-624b6015-dde3-4267-b06b-8d1a2f62fed7 admin admin] Calling method '>' {{(pid=109678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:33:24.142768 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: INFO nova.api.openstack.requestlog [None req-624b6015-dde3-4267-b06b-8d1a2f62fed7 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Jun 30 10:33:24.143165 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: [pid: 109678|app: 0|req: 16/33] 10.222.0.59 () {54 vars in 930 bytes} [Thu Jun 30 10:33:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:33:24.211090 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi [None req-e26b7c58-6d76-416f-810b-60d22536d99f admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "swap": 0, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.xlarge", "ram": 16384}} {{(pid=109679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:33:24.232233 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: INFO nova.api.openstack.requestlog [None req-e26b7c58-6d76-416f-810b-60d22536d99f admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.082674 Jun 30 10:33:24.233231 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: [pid: 109679|app: 0|req: 18/34] 10.222.0.59 () {64 vars in 1282 bytes} [Thu Jun 30 10:33:24 2022] POST /compute/v2.1/flavors => generated 408 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 30 10:33:24.245648 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi [None req-414b9347-ad37-4749-a42a-bf0d55d5e8be admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:33:24.273223 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: INFO nova.api.openstack.requestlog [None req-414b9347-ad37-4749-a42a-bf0d55d5e8be admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031220 Jun 30 10:33:24.280739 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: [pid: 109678|app: 0|req: 17/35] 10.222.0.59 () {64 vars in 1332 bytes} [Thu Jun 30 10:33:24 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:33:48.599611 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi [None req-e26b7c58-6d76-416f-810b-60d22536d99f admin admin] Calling method '>' {{(pid=109679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:33:48.600784 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: INFO nova.api.openstack.requestlog [None req-e26b7c58-6d76-416f-810b-60d22536d99f admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002105 Jun 30 10:33:48.601481 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: [pid: 109679|app: 0|req: 19/36] 10.222.0.59 () {54 vars in 930 bytes} [Thu Jun 30 10:33:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:33:48.611958 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG dbcounter [-] [109678] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=109678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:48.661562 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi [None req-e7a8bb0c-6ca4-48fb-895e-a8af5f316531 admin admin] Calling method '>' {{(pid=109678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:33:48.678348 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: INFO nova.api.openstack.requestlog [None req-e7a8bb0c-6ca4-48fb-895e-a8af5f316531 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.070949 Jun 30 10:33:48.678879 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: [pid: 109678|app: 0|req: 18/37] 10.222.0.59 () {60 vars in 1291 bytes} [Thu Jun 30 10:33:48 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:33:49.605284 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi [None req-e26b7c58-6d76-416f-810b-60d22536d99f admin admin] Calling method '>' {{(pid=109679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:33:49.606295 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: INFO nova.api.openstack.requestlog [None req-e26b7c58-6d76-416f-810b-60d22536d99f admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Jun 30 10:33:49.606693 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: [pid: 109679|app: 0|req: 20/38] 10.222.0.59 () {56 vars in 1074 bytes} [Thu Jun 30 10:33:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:33:49.795789 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi [None req-798e568a-0e28-4e1d-acfa-413ba4c74a65 admin admin] Calling method '>' {{(pid=109678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:33:49.801471 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: INFO nova.api.openstack.wsgi [None req-798e568a-0e28-4e1d-acfa-413ba4c74a65 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 30 10:33:49.804743 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi [None req-798e568a-0e28-4e1d-acfa-413ba4c74a65 admin admin] Request method failure captured: Jun 30 10:33:49.804743 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 30 10:33:49.804743 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: Accept: application/json Jun 30 10:33:49.804743 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: Accept-Encoding: gzip, deflate Jun 30 10:33:49.804743 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: Connection: keep-alive Jun 30 10:33:49.804743 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: Content-Length: 0 Jun 30 10:33:49.804743 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: Host: 10.222.0.59 Jun 30 10:33:49.804743 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: Openstack-Api-Version: compute 2.90 Jun 30 10:33:49.804743 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: Openstack-System-Scope: None Jun 30 10:33:49.804743 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: User-Agent: python-novaclient Jun 30 10:33:49.804743 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: X-Auth-Token: gAAAAABivXwN0FxmseNX_oFHbdWDoWaHCnSJtJWWTBFjEbuels1f2fuSQg0vTIYFjz-2UvcteCoX_aSj_57ZBieGFFg9XP7jXDzKYzbM8JTZRdn1sV8BKrRhY6PzIcK0NQwTLsPPuF29v3Yog-OBlWoHV5RHy5Ok-XwqVxfe1mu-951mje-6TXE Jun 30 10:33:49.804743 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: X-Domain-Id: None Jun 30 10:33:49.804743 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: X-Domain-Name: None Jun 30 10:33:49.804743 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: X-Identity-Status: Confirmed Jun 30 10:33:49.804743 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: X-Is-Admin-Project: True Jun 30 10:33:49.804743 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: X-Openstack-Nova-Api-Version: 2.90 Jun 30 10:33:49.804743 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: X-Project-Domain-Id: default Jun 30 10:33:49.804743 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: X-Project-Domain-Name: Default Jun 30 10:33:49.804743 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: X-Project-Id: e1140dfc0b9a4b21aa549fc69cc6961b Jun 30 10:33:49.804743 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: X-Project-Name: admin Jun 30 10:33:49.804743 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: X-Role: member,admin,reader Jun 30 10:33:49.804743 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: X-Roles: member,admin,reader Jun 30 10:33:49.806431 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e1140dfc0b9a4b21aa549fc69cc6961b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e1140dfc0b9a4b21aa549fc69cc6961b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e1140dfc0b9a4b21aa549fc69cc6961b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e1140dfc0b9a4b21aa549fc69cc6961b"}]}] Jun 30 10:33:49.806431 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: X-Tenant: admin Jun 30 10:33:49.806431 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: X-Tenant-Id: e1140dfc0b9a4b21aa549fc69cc6961b Jun 30 10:33:49.806431 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: X-Tenant-Name: admin Jun 30 10:33:49.806431 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: X-User: admin Jun 30 10:33:49.806431 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: X-User-Domain-Id: default Jun 30 10:33:49.806431 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: X-User-Domain-Name: Default Jun 30 10:33:49.806431 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: X-User-Id: 224404a1bd69482b9e7c4f685daaf4a4 Jun 30 10:33:49.806431 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: X-User-Name: admin Jun 30 10:33:49.806431 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: method: > Jun 30 10:33:49.806431 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: exception: Flavor 42 could not be found. Jun 30 10:33:49.806431 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: action_args: {'id': '42'} Jun 30 10:33:49.806431 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: {{(pid=109678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:33:49.806431 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:33:49.807363 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 30 10:33:49.807363 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 30 10:33:49.807363 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 30 10:33:49.807363 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 30 10:33:49.807363 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 30 10:33:49.807363 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 30 10:33:49.807363 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 30 10:33:49.807363 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 30 10:33:49.807363 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 30 10:33:49.807363 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:33:49.807363 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 30 10:33:49.807363 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 30 10:33:49.807363 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 30 10:33:49.807363 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi Jun 30 10:33:49.807363 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:33:49.807363 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi Jun 30 10:33:49.807363 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:33:49.807363 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:33:49.807363 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:33:49.808574 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:33:49.808574 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:33:49.808574 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:33:49.808574 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:33:49.808574 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 30 10:33:49.808574 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:33:49.808574 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 30 10:33:49.808574 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi Jun 30 10:33:49.808574 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:33:49.808574 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi Jun 30 10:33:49.808574 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:33:49.808574 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:33:49.808574 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:33:49.808574 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:33:49.808574 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:33:49.808574 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 30 10:33:49.808574 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi Jun 30 10:33:49.808574 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi [None req-798e568a-0e28-4e1d-acfa-413ba4c74a65 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:33:49.809956 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: INFO nova.api.openstack.requestlog [None req-798e568a-0e28-4e1d-acfa-413ba4c74a65 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.061197 Jun 30 10:33:49.809956 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: [pid: 109678|app: 0|req: 19/39] 10.222.0.59 () {60 vars in 1190 bytes} [Thu Jun 30 10:33:49 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 30 10:33:49.815692 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi [None req-c1768455-d5f9-4053-82b5-a0f1ef3517fc admin admin] Calling method '>' {{(pid=109679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:33:49.818628 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG dbcounter [-] [109679] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=109679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:49.838416 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: INFO nova.api.openstack.requestlog [None req-c1768455-d5f9-4053-82b5-a0f1ef3517fc admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026373 Jun 30 10:33:49.838948 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: [pid: 109679|app: 0|req: 21/40] 10.222.0.59 () {60 vars in 1210 bytes} [Thu Jun 30 10:33:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:33:49.849109 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi [None req-dd961871-e8de-4190-bbe8-ab95d391c8f3 admin admin] Calling method '>' {{(pid=109678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:33:49.881428 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: INFO nova.api.openstack.requestlog [None req-dd961871-e8de-4190-bbe8-ab95d391c8f3 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.036279 Jun 30 10:33:49.882365 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: [pid: 109678|app: 0|req: 20/41] 10.222.0.59 () {60 vars in 1210 bytes} [Thu Jun 30 10:33:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 10:33:49.892331 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi [None req-2ae17683-5ac4-4c6c-9f3d-ead537faa2fe admin admin] Calling method '>' {{(pid=109679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:33:49.899643 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: INFO nova.api.openstack.wsgi [None req-2ae17683-5ac4-4c6c-9f3d-ead537faa2fe admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 30 10:33:49.903045 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi [None req-2ae17683-5ac4-4c6c-9f3d-ead537faa2fe admin admin] Request method failure captured: Jun 30 10:33:49.903045 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 30 10:33:49.903045 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: Accept: application/json Jun 30 10:33:49.903045 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: Accept-Encoding: gzip, deflate Jun 30 10:33:49.903045 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: Connection: keep-alive Jun 30 10:33:49.903045 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: Content-Length: 0 Jun 30 10:33:49.903045 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: Host: 10.222.0.59 Jun 30 10:33:49.903045 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: Openstack-Api-Version: compute 2.90 Jun 30 10:33:49.903045 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: Openstack-System-Scope: None Jun 30 10:33:49.903045 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: User-Agent: python-novaclient Jun 30 10:33:49.903045 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: X-Auth-Token: gAAAAABivXwN0FxmseNX_oFHbdWDoWaHCnSJtJWWTBFjEbuels1f2fuSQg0vTIYFjz-2UvcteCoX_aSj_57ZBieGFFg9XP7jXDzKYzbM8JTZRdn1sV8BKrRhY6PzIcK0NQwTLsPPuF29v3Yog-OBlWoHV5RHy5Ok-XwqVxfe1mu-951mje-6TXE Jun 30 10:33:49.903045 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: X-Domain-Id: None Jun 30 10:33:49.903045 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: X-Domain-Name: None Jun 30 10:33:49.903045 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: X-Identity-Status: Confirmed Jun 30 10:33:49.903045 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: X-Is-Admin-Project: True Jun 30 10:33:49.903045 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: X-Openstack-Nova-Api-Version: 2.90 Jun 30 10:33:49.903045 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: X-Project-Domain-Id: default Jun 30 10:33:49.903045 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: X-Project-Domain-Name: Default Jun 30 10:33:49.903045 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: X-Project-Id: e1140dfc0b9a4b21aa549fc69cc6961b Jun 30 10:33:49.903045 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: X-Project-Name: admin Jun 30 10:33:49.903045 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: X-Role: member,admin,reader Jun 30 10:33:49.903045 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: X-Roles: member,admin,reader Jun 30 10:33:49.904580 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e1140dfc0b9a4b21aa549fc69cc6961b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e1140dfc0b9a4b21aa549fc69cc6961b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e1140dfc0b9a4b21aa549fc69cc6961b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e1140dfc0b9a4b21aa549fc69cc6961b"}]}] Jun 30 10:33:49.904580 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: X-Tenant: admin Jun 30 10:33:49.904580 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: X-Tenant-Id: e1140dfc0b9a4b21aa549fc69cc6961b Jun 30 10:33:49.904580 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: X-Tenant-Name: admin Jun 30 10:33:49.904580 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: X-User: admin Jun 30 10:33:49.904580 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: X-User-Domain-Id: default Jun 30 10:33:49.904580 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: X-User-Domain-Name: Default Jun 30 10:33:49.904580 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: X-User-Id: 224404a1bd69482b9e7c4f685daaf4a4 Jun 30 10:33:49.904580 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: X-User-Name: admin Jun 30 10:33:49.904580 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: method: > Jun 30 10:33:49.904580 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: exception: Flavor 42 could not be found. Jun 30 10:33:49.904580 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: action_args: {'id': '42'} Jun 30 10:33:49.904580 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: {{(pid=109679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:33:49.904580 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:33:49.905480 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 30 10:33:49.905480 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 30 10:33:49.905480 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 30 10:33:49.905480 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 30 10:33:49.905480 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 30 10:33:49.905480 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 30 10:33:49.905480 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 30 10:33:49.905480 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 30 10:33:49.905480 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 30 10:33:49.905480 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:33:49.905480 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 30 10:33:49.905480 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 30 10:33:49.905480 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 30 10:33:49.905480 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi Jun 30 10:33:49.905480 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:33:49.905480 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi Jun 30 10:33:49.905480 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:33:49.905480 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:33:49.905480 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:33:49.906497 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:33:49.906497 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:33:49.906497 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:33:49.906497 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:33:49.906497 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 30 10:33:49.906497 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:33:49.906497 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 30 10:33:49.906497 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi Jun 30 10:33:49.906497 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:33:49.906497 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi Jun 30 10:33:49.906497 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:33:49.906497 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:33:49.906497 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:33:49.906497 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:33:49.906497 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:33:49.906497 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 30 10:33:49.906497 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi Jun 30 10:33:49.906497 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi [None req-2ae17683-5ac4-4c6c-9f3d-ead537faa2fe admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:33:49.907526 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: INFO nova.api.openstack.requestlog [None req-2ae17683-5ac4-4c6c-9f3d-ead537faa2fe admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015898 Jun 30 10:33:49.907526 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: [pid: 109679|app: 0|req: 22/42] 10.222.0.59 () {60 vars in 1190 bytes} [Thu Jun 30 10:33:49 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 30 10:33:50.718888 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi [None req-dd961871-e8de-4190-bbe8-ab95d391c8f3 admin admin] Calling method '>' {{(pid=109678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:33:50.719892 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: INFO nova.api.openstack.requestlog [None req-dd961871-e8de-4190-bbe8-ab95d391c8f3 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Jun 30 10:33:50.720285 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: [pid: 109678|app: 0|req: 21/43] 10.222.0.59 () {56 vars in 1074 bytes} [Thu Jun 30 10:33:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:33:50.906811 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi [None req-bcb9b45f-391b-457d-926b-ff31ac8bc563 admin admin] Calling method '>' {{(pid=109679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:33:50.913284 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: INFO nova.api.openstack.wsgi [None req-bcb9b45f-391b-457d-926b-ff31ac8bc563 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 30 10:33:50.914823 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi [None req-bcb9b45f-391b-457d-926b-ff31ac8bc563 admin admin] Request method failure captured: Jun 30 10:33:50.914823 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 30 10:33:50.914823 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: Accept: application/json Jun 30 10:33:50.914823 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: Accept-Encoding: gzip, deflate Jun 30 10:33:50.914823 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: Connection: keep-alive Jun 30 10:33:50.914823 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: Content-Length: 0 Jun 30 10:33:50.914823 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: Host: 10.222.0.59 Jun 30 10:33:50.914823 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: Openstack-Api-Version: compute 2.90 Jun 30 10:33:50.914823 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: Openstack-System-Scope: None Jun 30 10:33:50.914823 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: User-Agent: python-novaclient Jun 30 10:33:50.914823 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: X-Auth-Token: gAAAAABivXwOfKyB0MuRrLeZTmb6QWkZoeK6J5hPv3UlETsFTw3-o3cWMCx7hAMK2kBcTUhDQdnny8QOXoHUAxLMUqrIyQpH2U8aJm1lRGjYCR8I7dzJHxQYw-v4s61QeSKTkI6W_z-C6fnJwCVcKX3rxHlkPy1NfLjkP0eHJt0dPkCTm2UyAhs Jun 30 10:33:50.914823 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: X-Domain-Id: None Jun 30 10:33:50.914823 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: X-Domain-Name: None Jun 30 10:33:50.914823 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: X-Identity-Status: Confirmed Jun 30 10:33:50.914823 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: X-Is-Admin-Project: True Jun 30 10:33:50.914823 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: X-Openstack-Nova-Api-Version: 2.90 Jun 30 10:33:50.914823 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: X-Project-Domain-Id: default Jun 30 10:33:50.914823 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: X-Project-Domain-Name: Default Jun 30 10:33:50.914823 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: X-Project-Id: e1140dfc0b9a4b21aa549fc69cc6961b Jun 30 10:33:50.914823 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: X-Project-Name: admin Jun 30 10:33:50.914823 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: X-Role: member,admin,reader Jun 30 10:33:50.914823 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: X-Roles: member,admin,reader Jun 30 10:33:50.916408 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e1140dfc0b9a4b21aa549fc69cc6961b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e1140dfc0b9a4b21aa549fc69cc6961b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e1140dfc0b9a4b21aa549fc69cc6961b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e1140dfc0b9a4b21aa549fc69cc6961b"}]}] Jun 30 10:33:50.916408 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: X-Tenant: admin Jun 30 10:33:50.916408 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: X-Tenant-Id: e1140dfc0b9a4b21aa549fc69cc6961b Jun 30 10:33:50.916408 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: X-Tenant-Name: admin Jun 30 10:33:50.916408 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: X-User: admin Jun 30 10:33:50.916408 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: X-User-Domain-Id: default Jun 30 10:33:50.916408 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: X-User-Domain-Name: Default Jun 30 10:33:50.916408 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: X-User-Id: 224404a1bd69482b9e7c4f685daaf4a4 Jun 30 10:33:50.916408 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: X-User-Name: admin Jun 30 10:33:50.916408 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: method: > Jun 30 10:33:50.916408 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: exception: Flavor 84 could not be found. Jun 30 10:33:50.916408 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: action_args: {'id': '84'} Jun 30 10:33:50.916408 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: {{(pid=109679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:33:50.916408 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:33:50.917314 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 30 10:33:50.917314 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 30 10:33:50.917314 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 30 10:33:50.917314 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 30 10:33:50.917314 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 30 10:33:50.917314 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 30 10:33:50.917314 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 30 10:33:50.917314 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 30 10:33:50.917314 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 30 10:33:50.917314 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:33:50.917314 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 30 10:33:50.917314 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 30 10:33:50.917314 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 30 10:33:50.917314 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi Jun 30 10:33:50.917314 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:33:50.917314 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi Jun 30 10:33:50.917314 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:33:50.917314 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:33:50.917314 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:33:50.918633 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:33:50.918633 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:33:50.918633 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:33:50.918633 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:33:50.918633 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 30 10:33:50.918633 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:33:50.918633 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 30 10:33:50.918633 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi Jun 30 10:33:50.918633 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:33:50.918633 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi Jun 30 10:33:50.918633 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:33:50.918633 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:33:50.918633 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:33:50.918633 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:33:50.918633 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:33:50.918633 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 30 10:33:50.918633 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi Jun 30 10:33:50.918633 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi [None req-bcb9b45f-391b-457d-926b-ff31ac8bc563 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:33:50.919901 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: INFO nova.api.openstack.requestlog [None req-bcb9b45f-391b-457d-926b-ff31ac8bc563 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.060551 Jun 30 10:33:50.919901 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: [pid: 109679|app: 0|req: 23/44] 10.222.0.59 () {60 vars in 1190 bytes} [Thu Jun 30 10:33:50 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 30 10:33:50.925652 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi [None req-83bfdddb-4128-486e-86d4-2d751616364c admin admin] Calling method '>' {{(pid=109678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:33:50.941383 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: INFO nova.api.openstack.requestlog [None req-83bfdddb-4128-486e-86d4-2d751616364c admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019203 Jun 30 10:33:50.941894 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: [pid: 109678|app: 0|req: 22/45] 10.222.0.59 () {60 vars in 1210 bytes} [Thu Jun 30 10:33:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:33:50.951435 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi [None req-acdfeef0-eea3-4e84-970d-7122a31c4206 admin admin] Calling method '>' {{(pid=109679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:33:50.966699 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: INFO nova.api.openstack.requestlog [None req-acdfeef0-eea3-4e84-970d-7122a31c4206 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018833 Jun 30 10:33:50.967225 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: [pid: 109679|app: 0|req: 24/46] 10.222.0.59 () {60 vars in 1210 bytes} [Thu Jun 30 10:33:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 10:33:50.977152 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi [None req-2cd04752-ad97-488d-b0e6-e370afdf1df4 admin admin] Calling method '>' {{(pid=109678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:33:50.982544 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: INFO nova.api.openstack.wsgi [None req-2cd04752-ad97-488d-b0e6-e370afdf1df4 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 30 10:33:50.984327 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi [None req-2cd04752-ad97-488d-b0e6-e370afdf1df4 admin admin] Request method failure captured: Jun 30 10:33:50.984327 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 30 10:33:50.984327 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: Accept: application/json Jun 30 10:33:50.984327 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: Accept-Encoding: gzip, deflate Jun 30 10:33:50.984327 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: Connection: keep-alive Jun 30 10:33:50.984327 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: Content-Length: 0 Jun 30 10:33:50.984327 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: Host: 10.222.0.59 Jun 30 10:33:50.984327 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: Openstack-Api-Version: compute 2.90 Jun 30 10:33:50.984327 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: Openstack-System-Scope: None Jun 30 10:33:50.984327 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: User-Agent: python-novaclient Jun 30 10:33:50.984327 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: X-Auth-Token: gAAAAABivXwOfKyB0MuRrLeZTmb6QWkZoeK6J5hPv3UlETsFTw3-o3cWMCx7hAMK2kBcTUhDQdnny8QOXoHUAxLMUqrIyQpH2U8aJm1lRGjYCR8I7dzJHxQYw-v4s61QeSKTkI6W_z-C6fnJwCVcKX3rxHlkPy1NfLjkP0eHJt0dPkCTm2UyAhs Jun 30 10:33:50.984327 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: X-Domain-Id: None Jun 30 10:33:50.984327 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: X-Domain-Name: None Jun 30 10:33:50.984327 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: X-Identity-Status: Confirmed Jun 30 10:33:50.984327 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: X-Is-Admin-Project: True Jun 30 10:33:50.984327 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: X-Openstack-Nova-Api-Version: 2.90 Jun 30 10:33:50.984327 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: X-Project-Domain-Id: default Jun 30 10:33:50.984327 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: X-Project-Domain-Name: Default Jun 30 10:33:50.984327 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: X-Project-Id: e1140dfc0b9a4b21aa549fc69cc6961b Jun 30 10:33:50.984327 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: X-Project-Name: admin Jun 30 10:33:50.984327 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: X-Role: member,admin,reader Jun 30 10:33:50.984327 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: X-Roles: member,admin,reader Jun 30 10:33:50.985886 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e1140dfc0b9a4b21aa549fc69cc6961b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e1140dfc0b9a4b21aa549fc69cc6961b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e1140dfc0b9a4b21aa549fc69cc6961b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e1140dfc0b9a4b21aa549fc69cc6961b"}]}] Jun 30 10:33:50.985886 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: X-Tenant: admin Jun 30 10:33:50.985886 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: X-Tenant-Id: e1140dfc0b9a4b21aa549fc69cc6961b Jun 30 10:33:50.985886 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: X-Tenant-Name: admin Jun 30 10:33:50.985886 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: X-User: admin Jun 30 10:33:50.985886 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: X-User-Domain-Id: default Jun 30 10:33:50.985886 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: X-User-Domain-Name: Default Jun 30 10:33:50.985886 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: X-User-Id: 224404a1bd69482b9e7c4f685daaf4a4 Jun 30 10:33:50.985886 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: X-User-Name: admin Jun 30 10:33:50.985886 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: method: > Jun 30 10:33:50.985886 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: exception: Flavor 84 could not be found. Jun 30 10:33:50.985886 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: action_args: {'id': '84'} Jun 30 10:33:50.985886 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: {{(pid=109678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:33:50.985886 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:33:50.986824 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 30 10:33:50.986824 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 30 10:33:50.986824 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 30 10:33:50.986824 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 30 10:33:50.986824 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 30 10:33:50.986824 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 30 10:33:50.986824 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 30 10:33:50.986824 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 30 10:33:50.986824 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 30 10:33:50.986824 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:33:50.986824 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 30 10:33:50.986824 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 30 10:33:50.986824 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 30 10:33:50.986824 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi Jun 30 10:33:50.986824 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:33:50.986824 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi Jun 30 10:33:50.986824 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:33:50.986824 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:33:50.986824 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:33:50.988171 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:33:50.988171 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:33:50.988171 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:33:50.988171 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:33:50.988171 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 30 10:33:50.988171 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:33:50.988171 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 30 10:33:50.988171 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi Jun 30 10:33:50.988171 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:33:50.988171 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi Jun 30 10:33:50.988171 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:33:50.988171 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:33:50.988171 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:33:50.988171 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:33:50.988171 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:33:50.988171 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 30 10:33:50.988171 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi Jun 30 10:33:50.988171 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi [None req-2cd04752-ad97-488d-b0e6-e370afdf1df4 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:33:50.990057 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: INFO nova.api.openstack.requestlog [None req-2cd04752-ad97-488d-b0e6-e370afdf1df4 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012936 Jun 30 10:33:50.990057 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: [pid: 109678|app: 0|req: 23/47] 10.222.0.59 () {60 vars in 1190 bytes} [Thu Jun 30 10:33:50 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 30 10:33:51.800036 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi [None req-acdfeef0-eea3-4e84-970d-7122a31c4206 admin admin] Calling method '>' {{(pid=109679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:33:51.801096 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: INFO nova.api.openstack.requestlog [None req-acdfeef0-eea3-4e84-970d-7122a31c4206 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Jun 30 10:33:51.801491 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: [pid: 109679|app: 0|req: 25/48] 10.222.0.59 () {56 vars in 1074 bytes} [Thu Jun 30 10:33:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:33:51.987994 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi [None req-61bc712b-c4cc-491c-a672-4ba6694e7392 admin admin] Calling method '>' {{(pid=109678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:33:51.995011 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: INFO nova.api.openstack.wsgi [None req-61bc712b-c4cc-491c-a672-4ba6694e7392 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 30 10:33:51.996533 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi [None req-61bc712b-c4cc-491c-a672-4ba6694e7392 admin admin] Request method failure captured: Jun 30 10:33:51.996533 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 30 10:33:51.996533 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: Accept: application/json Jun 30 10:33:51.996533 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: Accept-Encoding: gzip, deflate Jun 30 10:33:51.996533 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: Connection: keep-alive Jun 30 10:33:51.996533 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: Content-Length: 0 Jun 30 10:33:51.996533 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: Host: 10.222.0.59 Jun 30 10:33:51.996533 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: Openstack-Api-Version: compute 2.90 Jun 30 10:33:51.996533 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: Openstack-System-Scope: None Jun 30 10:33:51.996533 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: User-Agent: python-novaclient Jun 30 10:33:51.996533 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: X-Auth-Token: gAAAAABivXwPy_-64A1XzvVykz7yIixEa1hvGyrW30z0Jg2-sPR6NTUKOIEZm7SEAieBNFb-HltVMN1KYA8STlrp0GxGe7dfW_KTD9kQ5P6wX6EAUBwh_i6Gf6cZA_qbbx4lT2SqAkDa1KVBIrIxBLK0FfGX7nI86FW2xb5tTXHVE5R754Ioq3Y Jun 30 10:33:51.996533 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: X-Domain-Id: None Jun 30 10:33:51.996533 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: X-Domain-Name: None Jun 30 10:33:51.996533 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: X-Identity-Status: Confirmed Jun 30 10:33:51.996533 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: X-Is-Admin-Project: True Jun 30 10:33:51.996533 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: X-Openstack-Nova-Api-Version: 2.90 Jun 30 10:33:51.996533 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: X-Project-Domain-Id: default Jun 30 10:33:51.996533 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: X-Project-Domain-Name: Default Jun 30 10:33:51.996533 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: X-Project-Id: e1140dfc0b9a4b21aa549fc69cc6961b Jun 30 10:33:51.996533 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: X-Project-Name: admin Jun 30 10:33:51.996533 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: X-Role: member,admin,reader Jun 30 10:33:51.996533 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: X-Roles: member,admin,reader Jun 30 10:33:51.998037 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e1140dfc0b9a4b21aa549fc69cc6961b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e1140dfc0b9a4b21aa549fc69cc6961b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e1140dfc0b9a4b21aa549fc69cc6961b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e1140dfc0b9a4b21aa549fc69cc6961b"}]}] Jun 30 10:33:51.998037 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: X-Tenant: admin Jun 30 10:33:51.998037 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: X-Tenant-Id: e1140dfc0b9a4b21aa549fc69cc6961b Jun 30 10:33:51.998037 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: X-Tenant-Name: admin Jun 30 10:33:51.998037 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: X-User: admin Jun 30 10:33:51.998037 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: X-User-Domain-Id: default Jun 30 10:33:51.998037 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: X-User-Domain-Name: Default Jun 30 10:33:51.998037 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: X-User-Id: 224404a1bd69482b9e7c4f685daaf4a4 Jun 30 10:33:51.998037 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: X-User-Name: admin Jun 30 10:33:51.998037 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: method: > Jun 30 10:33:51.998037 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: exception: Flavor 451 could not be found. Jun 30 10:33:51.998037 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: action_args: {'id': '451'} Jun 30 10:33:51.998037 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: {{(pid=109678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:33:51.998037 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:33:51.999074 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 30 10:33:51.999074 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 30 10:33:51.999074 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 30 10:33:51.999074 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 30 10:33:51.999074 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 30 10:33:51.999074 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 30 10:33:51.999074 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 30 10:33:51.999074 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 30 10:33:51.999074 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 30 10:33:51.999074 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:33:51.999074 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 30 10:33:51.999074 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 30 10:33:51.999074 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 30 10:33:51.999074 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi Jun 30 10:33:51.999074 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:33:51.999074 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi Jun 30 10:33:51.999074 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:33:51.999074 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:33:51.999074 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:33:52.000482 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:33:52.000482 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:33:52.000482 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:33:52.000482 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:33:52.000482 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 30 10:33:52.000482 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:33:52.000482 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 30 10:33:52.000482 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi Jun 30 10:33:52.000482 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:33:52.000482 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi Jun 30 10:33:52.000482 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:33:52.000482 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:33:52.000482 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:33:52.000482 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:33:52.000482 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:33:52.000482 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 30 10:33:52.000482 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: ERROR nova.api.openstack.wsgi Jun 30 10:33:52.000482 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi [None req-61bc712b-c4cc-491c-a672-4ba6694e7392 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:33:52.001760 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: INFO nova.api.openstack.requestlog [None req-61bc712b-c4cc-491c-a672-4ba6694e7392 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.061071 Jun 30 10:33:52.001760 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: [pid: 109678|app: 0|req: 24/49] 10.222.0.59 () {60 vars in 1193 bytes} [Thu Jun 30 10:33:51 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 30 10:33:52.008575 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi [None req-61fbe4fc-5f00-41f1-b444-5b1ca74bf7c0 admin admin] Calling method '>' {{(pid=109679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:33:52.022030 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: INFO nova.api.openstack.requestlog [None req-61fbe4fc-5f00-41f1-b444-5b1ca74bf7c0 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017825 Jun 30 10:33:52.022587 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: [pid: 109679|app: 0|req: 26/50] 10.222.0.59 () {60 vars in 1210 bytes} [Thu Jun 30 10:33:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:33:52.031718 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi [None req-548b5fe9-3ca2-40e9-8f86-6b3d733cc200 admin admin] Calling method '>' {{(pid=109678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:33:52.045072 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: INFO nova.api.openstack.requestlog [None req-548b5fe9-3ca2-40e9-8f86-6b3d733cc200 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016808 Jun 30 10:33:52.045589 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: [pid: 109678|app: 0|req: 25/51] 10.222.0.59 () {60 vars in 1210 bytes} [Thu Jun 30 10:33:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:33:52.055444 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi [None req-47c646a3-f5c0-436e-b955-27051483dc42 admin admin] Calling method '>' {{(pid=109679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:33:52.060802 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: INFO nova.api.openstack.wsgi [None req-47c646a3-f5c0-436e-b955-27051483dc42 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 30 10:33:52.062291 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi [None req-47c646a3-f5c0-436e-b955-27051483dc42 admin admin] Request method failure captured: Jun 30 10:33:52.062291 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 30 10:33:52.062291 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: Accept: application/json Jun 30 10:33:52.062291 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: Accept-Encoding: gzip, deflate Jun 30 10:33:52.062291 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: Connection: keep-alive Jun 30 10:33:52.062291 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: Content-Length: 0 Jun 30 10:33:52.062291 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: Host: 10.222.0.59 Jun 30 10:33:52.062291 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: Openstack-Api-Version: compute 2.90 Jun 30 10:33:52.062291 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: Openstack-System-Scope: None Jun 30 10:33:52.062291 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: User-Agent: python-novaclient Jun 30 10:33:52.062291 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: X-Auth-Token: gAAAAABivXwPy_-64A1XzvVykz7yIixEa1hvGyrW30z0Jg2-sPR6NTUKOIEZm7SEAieBNFb-HltVMN1KYA8STlrp0GxGe7dfW_KTD9kQ5P6wX6EAUBwh_i6Gf6cZA_qbbx4lT2SqAkDa1KVBIrIxBLK0FfGX7nI86FW2xb5tTXHVE5R754Ioq3Y Jun 30 10:33:52.062291 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: X-Domain-Id: None Jun 30 10:33:52.062291 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: X-Domain-Name: None Jun 30 10:33:52.062291 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: X-Identity-Status: Confirmed Jun 30 10:33:52.062291 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: X-Is-Admin-Project: True Jun 30 10:33:52.062291 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: X-Openstack-Nova-Api-Version: 2.90 Jun 30 10:33:52.062291 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: X-Project-Domain-Id: default Jun 30 10:33:52.062291 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: X-Project-Domain-Name: Default Jun 30 10:33:52.062291 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: X-Project-Id: e1140dfc0b9a4b21aa549fc69cc6961b Jun 30 10:33:52.062291 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: X-Project-Name: admin Jun 30 10:33:52.062291 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: X-Role: member,admin,reader Jun 30 10:33:52.062291 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: X-Roles: member,admin,reader Jun 30 10:33:52.063852 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e1140dfc0b9a4b21aa549fc69cc6961b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e1140dfc0b9a4b21aa549fc69cc6961b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e1140dfc0b9a4b21aa549fc69cc6961b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e1140dfc0b9a4b21aa549fc69cc6961b"}]}] Jun 30 10:33:52.063852 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: X-Tenant: admin Jun 30 10:33:52.063852 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: X-Tenant-Id: e1140dfc0b9a4b21aa549fc69cc6961b Jun 30 10:33:52.063852 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: X-Tenant-Name: admin Jun 30 10:33:52.063852 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: X-User: admin Jun 30 10:33:52.063852 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: X-User-Domain-Id: default Jun 30 10:33:52.063852 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: X-User-Domain-Name: Default Jun 30 10:33:52.063852 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: X-User-Id: 224404a1bd69482b9e7c4f685daaf4a4 Jun 30 10:33:52.063852 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: X-User-Name: admin Jun 30 10:33:52.063852 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: method: > Jun 30 10:33:52.063852 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: exception: Flavor 451 could not be found. Jun 30 10:33:52.063852 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: action_args: {'id': '451'} Jun 30 10:33:52.063852 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: {{(pid=109679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:33:52.063852 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:33:52.064833 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 30 10:33:52.064833 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 30 10:33:52.064833 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 30 10:33:52.064833 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 30 10:33:52.064833 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 30 10:33:52.064833 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 30 10:33:52.064833 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 30 10:33:52.064833 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 30 10:33:52.064833 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 30 10:33:52.064833 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:33:52.064833 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 30 10:33:52.064833 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 30 10:33:52.064833 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 30 10:33:52.064833 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi Jun 30 10:33:52.064833 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:33:52.064833 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi Jun 30 10:33:52.064833 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:33:52.064833 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:33:52.064833 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:33:52.066086 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:33:52.066086 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:33:52.066086 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:33:52.066086 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:33:52.066086 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 30 10:33:52.066086 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:33:52.066086 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 30 10:33:52.066086 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi Jun 30 10:33:52.066086 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:33:52.066086 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi Jun 30 10:33:52.066086 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:33:52.066086 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:33:52.066086 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:33:52.066086 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:33:52.066086 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:33:52.066086 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 30 10:33:52.066086 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: ERROR nova.api.openstack.wsgi Jun 30 10:33:52.066086 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi [None req-47c646a3-f5c0-436e-b955-27051483dc42 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:33:52.067986 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: INFO nova.api.openstack.requestlog [None req-47c646a3-f5c0-436e-b955-27051483dc42 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011696 Jun 30 10:33:52.067986 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: [pid: 109679|app: 0|req: 27/52] 10.222.0.59 () {60 vars in 1193 bytes} [Thu Jun 30 10:33:52 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 30 10:33:52.882477 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi [None req-548b5fe9-3ca2-40e9-8f86-6b3d733cc200 admin admin] Calling method '>' {{(pid=109678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:33:52.883494 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: INFO nova.api.openstack.requestlog [None req-548b5fe9-3ca2-40e9-8f86-6b3d733cc200 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Jun 30 10:33:52.883895 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: [pid: 109678|app: 0|req: 26/53] 10.222.0.59 () {56 vars in 1074 bytes} [Thu Jun 30 10:33:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:33:53.074434 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi [None req-8e879ccb-8435-459c-b920-7cec3eea7ca7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:33:53.091724 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: INFO nova.api.openstack.requestlog [None req-8e879ccb-8435-459c-b920-7cec3eea7ca7 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.068664 Jun 30 10:33:53.092193 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: [pid: 109679|app: 0|req: 28/54] 10.222.0.59 () {64 vars in 1235 bytes} [Thu Jun 30 10:33:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 10:33:53.902303 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi [None req-548b5fe9-3ca2-40e9-8f86-6b3d733cc200 admin admin] Calling method '>' {{(pid=109678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:33:53.903335 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: INFO nova.api.openstack.requestlog [None req-548b5fe9-3ca2-40e9-8f86-6b3d733cc200 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Jun 30 10:33:53.903729 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: [pid: 109678|app: 0|req: 27/55] 10.222.0.59 () {56 vars in 1074 bytes} [Thu Jun 30 10:33:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:33:54.091041 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi [None req-01fad7ee-014b-47b3-8542-ff363bd11280 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:33:54.108108 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: INFO nova.api.openstack.requestlog [None req-01fad7ee-014b-47b3-8542-ff363bd11280 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.067746 Jun 30 10:33:54.108663 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: [pid: 109679|app: 0|req: 29/56] 10.222.0.59 () {64 vars in 1235 bytes} [Thu Jun 30 10:33:54 2022] POST /compute/v2.1/flavors => generated 405 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 10:33:54.934256 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi [None req-548b5fe9-3ca2-40e9-8f86-6b3d733cc200 admin admin] Calling method '>' {{(pid=109678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:33:54.935255 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: INFO nova.api.openstack.requestlog [None req-548b5fe9-3ca2-40e9-8f86-6b3d733cc200 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 Jun 30 10:33:54.935644 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: [pid: 109678|app: 0|req: 28/57] 10.222.0.59 () {56 vars in 1074 bytes} [Thu Jun 30 10:33:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:33:55.122327 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi [None req-8bb75740-e9fa-4d4f-898d-15f8ca7db24a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:33:55.139734 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: INFO nova.api.openstack.requestlog [None req-8bb75740-e9fa-4d4f-898d-15f8ca7db24a admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.068015 Jun 30 10:33:55.140288 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: [pid: 109679|app: 0|req: 30/58] 10.222.0.59 () {64 vars in 1235 bytes} [Thu Jun 30 10:33:55 2022] POST /compute/v2.1/flavors => generated 407 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 10:33:55.956476 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi [None req-548b5fe9-3ca2-40e9-8f86-6b3d733cc200 admin admin] Calling method '>' {{(pid=109678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:33:55.957999 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: INFO nova.api.openstack.requestlog [None req-548b5fe9-3ca2-40e9-8f86-6b3d733cc200 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Jun 30 10:33:55.958592 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: [pid: 109678|app: 0|req: 29/59] 10.222.0.59 () {56 vars in 1074 bytes} [Thu Jun 30 10:33:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:33:56.151332 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi [None req-681f7dd0-dfd3-426a-b6b6-643166e6bc00 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:33:56.168547 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: INFO nova.api.openstack.requestlog [None req-681f7dd0-dfd3-426a-b6b6-643166e6bc00 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.068427 Jun 30 10:33:56.169032 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: [pid: 109679|app: 0|req: 31/60] 10.222.0.59 () {64 vars in 1235 bytes} [Thu Jun 30 10:33:56 2022] POST /compute/v2.1/flavors => generated 409 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 10:33:56.986725 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi [None req-548b5fe9-3ca2-40e9-8f86-6b3d733cc200 admin admin] Calling method '>' {{(pid=109678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:33:56.987763 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: INFO nova.api.openstack.requestlog [None req-548b5fe9-3ca2-40e9-8f86-6b3d733cc200 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Jun 30 10:33:56.988158 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: [pid: 109678|app: 0|req: 30/61] 10.222.0.59 () {56 vars in 1074 bytes} [Thu Jun 30 10:33:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:33:57.175834 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi [None req-30f9ea5d-29c7-42e7-b0cb-813ec66bbcde admin admin] Calling method '>' {{(pid=109679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:33:57.195371 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: INFO nova.api.openstack.requestlog [None req-30f9ea5d-29c7-42e7-b0cb-813ec66bbcde admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069535 Jun 30 10:33:57.195908 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: [pid: 109679|app: 0|req: 32/62] 10.222.0.59 () {60 vars in 1202 bytes} [Thu Jun 30 10:33:57 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:34:43.587698 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi [None req-548b5fe9-3ca2-40e9-8f86-6b3d733cc200 admin admin] Calling method '>' {{(pid=109678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:34:43.588747 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: INFO nova.api.openstack.requestlog [None req-548b5fe9-3ca2-40e9-8f86-6b3d733cc200 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Jun 30 10:34:43.589152 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: [pid: 109678|app: 0|req: 31/63] 10.222.0.59 () {54 vars in 930 bytes} [Thu Jun 30 10:34:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:34:43.599585 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG dbcounter [-] [109679] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=109679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:43.647719 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi [None req-fc70819f-3788-4a50-b7a7-d6ee81488410 admin admin] Calling method '>' {{(pid=109679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:34:43.666416 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: INFO nova.api.openstack.requestlog [None req-fc70819f-3788-4a50-b7a7-d6ee81488410 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.071228 Jun 30 10:34:43.666981 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: [pid: 109679|app: 0|req: 33/64] 10.222.0.59 () {60 vars in 1291 bytes} [Thu Jun 30 10:34:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:34:43.689439 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi [None req-c0741218-80eb-49e4-858a-8607211889cd admin admin] Calling method '>' {{(pid=109678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:34:43.693384 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG dbcounter [-] [109678] Writing DB stats nova_api:SELECT=14 {{(pid=109678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:43.699182 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: INFO nova.api.openstack.requestlog [None req-c0741218-80eb-49e4-858a-8607211889cd admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013633 Jun 30 10:34:43.699726 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: [pid: 109678|app: 0|req: 32/65] 10.222.0.59 () {60 vars in 1282 bytes} [Thu Jun 30 10:34:43 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:34:43.711470 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi [None req-f4d2ae9b-ff35-45e8-998c-418559cbe679 admin admin] Calling method '>' {{(pid=109679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:34:43.719224 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: INFO nova.api.openstack.requestlog [None req-f4d2ae9b-ff35-45e8-998c-418559cbe679 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011387 Jun 30 10:34:43.719744 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: [pid: 109679|app: 0|req: 34/66] 10.222.0.59 () {60 vars in 1285 bytes} [Thu Jun 30 10:34:43 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:34:43.730829 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi [None req-4b935dd4-d121-4e49-9e39-11d817ee5b5c admin admin] Calling method '>' {{(pid=109678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:34:43.738755 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: INFO nova.api.openstack.requestlog [None req-4b935dd4-d121-4e49-9e39-11d817ee5b5c admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011369 Jun 30 10:34:43.739265 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: [pid: 109678|app: 0|req: 33/67] 10.222.0.59 () {60 vars in 1285 bytes} [Thu Jun 30 10:34:43 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:34:43.749779 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi [None req-ec8070b3-7e56-4bd7-b849-9bd5f6eb31b5 admin admin] Calling method '>' {{(pid=109679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:34:43.757894 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: INFO nova.api.openstack.requestlog [None req-ec8070b3-7e56-4bd7-b849-9bd5f6eb31b5 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011457 Jun 30 10:34:43.758403 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: [pid: 109679|app: 0|req: 35/68] 10.222.0.59 () {60 vars in 1282 bytes} [Thu Jun 30 10:34:43 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:37:58.975181 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi [None req-4b935dd4-d121-4e49-9e39-11d817ee5b5c admin admin] Calling method '>' {{(pid=109678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:37:58.976262 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: INFO nova.api.openstack.requestlog [None req-4b935dd4-d121-4e49-9e39-11d817ee5b5c admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Jun 30 10:37:58.976690 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: [pid: 109678|app: 0|req: 34/69] 10.222.0.59 () {56 vars in 1074 bytes} [Thu Jun 30 10:37:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:37:59.121353 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG dbcounter [-] [109679] Writing DB stats nova_api:SELECT=6 {{(pid=109679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:37:59.236410 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi [None req-1307b39e-bc88-41b7-8068-83521d9b1082 admin admin] Calling method '>' {{(pid=109679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:37:59.237602 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 10:37:59.237602 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: warnings.warn(msg) Jun 30 10:37:59.238797 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG oslo_concurrency.lockutils [None req-1307b39e-bc88-41b7-8068-83521d9b1082 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:37:59.239238 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG oslo_concurrency.lockutils [None req-1307b39e-bc88-41b7-8068-83521d9b1082 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:37:59.240025 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG oslo_concurrency.lockutils [None req-1307b39e-bc88-41b7-8068-83521d9b1082 admin admin] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:37:59.240453 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG oslo_concurrency.lockutils [None req-1307b39e-bc88-41b7-8068-83521d9b1082 admin admin] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:37:59.274173 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: INFO nova.api.openstack.requestlog [None req-1307b39e-bc88-41b7-8068-83521d9b1082 admin admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.154234 Jun 30 10:37:59.274745 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: [pid: 109679|app: 0|req: 36/70] 10.222.0.59 () {60 vars in 1193 bytes} [Thu Jun 30 10:37:59 2022] GET /compute/v2.1/os-services => generated 791 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 10:38:00.095554 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi [None req-4b935dd4-d121-4e49-9e39-11d817ee5b5c admin admin] Calling method '>' {{(pid=109678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:38:00.096588 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: INFO nova.api.openstack.requestlog [None req-4b935dd4-d121-4e49-9e39-11d817ee5b5c admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002062 Jun 30 10:38:00.096999 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: [pid: 109678|app: 0|req: 35/71] 10.222.0.59 () {56 vars in 1074 bytes} [Thu Jun 30 10:38:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:38:00.285650 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi [None req-74f48044-0a7e-4b26-803c-8d71d01f8242 admin admin] Calling method '>' {{(pid=109679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:38:00.286827 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 10:38:00.286827 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: warnings.warn(msg) Jun 30 10:38:00.288006 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG oslo_concurrency.lockutils [None req-74f48044-0a7e-4b26-803c-8d71d01f8242 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:38:00.288446 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG oslo_concurrency.lockutils [None req-74f48044-0a7e-4b26-803c-8d71d01f8242 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:38:00.289255 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG oslo_concurrency.lockutils [None req-74f48044-0a7e-4b26-803c-8d71d01f8242 admin admin] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:38:00.289682 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG oslo_concurrency.lockutils [None req-74f48044-0a7e-4b26-803c-8d71d01f8242 admin admin] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:38:00.309036 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: INFO nova.api.openstack.requestlog [None req-74f48044-0a7e-4b26-803c-8d71d01f8242 admin admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.074716 Jun 30 10:38:00.309515 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: [pid: 109679|app: 0|req: 37/72] 10.222.0.59 () {60 vars in 1193 bytes} [Thu Jun 30 10:38:00 2022] GET /compute/v2.1/os-services => generated 791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 10:38:11.552438 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi [None req-4b935dd4-d121-4e49-9e39-11d817ee5b5c admin admin] Calling method '>' {{(pid=109678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:38:11.553511 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: INFO nova.api.openstack.requestlog [None req-4b935dd4-d121-4e49-9e39-11d817ee5b5c admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Jun 30 10:38:11.553907 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: [pid: 109678|app: 0|req: 36/73] 10.222.0.59 () {56 vars in 1074 bytes} [Thu Jun 30 10:38:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:38:11.697942 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG dbcounter [-] [109679] Writing DB stats nova_cell0:SELECT=4 {{(pid=109679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:38:11.698657 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG dbcounter [-] [109679] Writing DB stats nova_cell1:SELECT=4 {{(pid=109679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:38:11.699267 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG dbcounter [-] [109679] Writing DB stats nova_api:SELECT=8 {{(pid=109679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:38:11.746608 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi [None req-8570d0c5-b96e-4558-9343-66bc89ad7768 admin admin] Calling method '>' {{(pid=109679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:38:11.747807 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 10:38:11.747807 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: warnings.warn(msg) Jun 30 10:38:11.749057 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG oslo_concurrency.lockutils [None req-8570d0c5-b96e-4558-9343-66bc89ad7768 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:38:11.749503 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG oslo_concurrency.lockutils [None req-8570d0c5-b96e-4558-9343-66bc89ad7768 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:38:11.750294 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG oslo_concurrency.lockutils [None req-8570d0c5-b96e-4558-9343-66bc89ad7768 admin admin] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:38:11.750729 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG oslo_concurrency.lockutils [None req-8570d0c5-b96e-4558-9343-66bc89ad7768 admin admin] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:38:11.775593 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: INFO nova.api.openstack.requestlog [None req-8570d0c5-b96e-4558-9343-66bc89ad7768 admin admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.081956 Jun 30 10:38:11.776077 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: [pid: 109679|app: 0|req: 38/74] 10.222.0.59 () {60 vars in 1193 bytes} [Thu Jun 30 10:38:11 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:38:12.589156 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: DEBUG nova.api.openstack.wsgi [None req-4b935dd4-d121-4e49-9e39-11d817ee5b5c admin admin] Calling method '>' {{(pid=109678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:38:12.590169 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: INFO nova.api.openstack.requestlog [None req-4b935dd4-d121-4e49-9e39-11d817ee5b5c admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jun 30 10:38:12.590573 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: [pid: 109678|app: 0|req: 37/75] 10.222.0.59 () {56 vars in 1074 bytes} [Thu Jun 30 10:38:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:38:12.781774 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG nova.api.openstack.wsgi [None req-94188ad0-912a-4f6c-8663-730250ce47a9 admin admin] Calling method '>' {{(pid=109679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:38:12.783564 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 10:38:12.783564 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: warnings.warn(msg) Jun 30 10:38:12.784758 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG oslo_concurrency.lockutils [None req-94188ad0-912a-4f6c-8663-730250ce47a9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:38:12.785197 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG oslo_concurrency.lockutils [None req-94188ad0-912a-4f6c-8663-730250ce47a9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:38:12.785981 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG oslo_concurrency.lockutils [None req-94188ad0-912a-4f6c-8663-730250ce47a9 admin admin] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:38:12.786406 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: DEBUG oslo_concurrency.lockutils [None req-94188ad0-912a-4f6c-8663-730250ce47a9 admin admin] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:38:12.807554 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: INFO nova.api.openstack.requestlog [None req-94188ad0-912a-4f6c-8663-730250ce47a9 admin admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.076541 Jun 30 10:38:12.808028 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: [pid: 109679|app: 0|req: 39/76] 10.222.0.59 () {60 vars in 1193 bytes} [Thu Jun 30 10:38:12 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:39:08.931546 dv-cinder-822822-2-iscsi devstack@n-api.service[109677]: Thu Jun 30 10:39:08 2022 - graceful shutdown triggered... Jun 30 10:39:08.931657 dv-cinder-822822-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 30 10:39:08.932620 dv-cinder-822822-2-iscsi devstack@n-api.service[109678]: Gracefully killing worker 1 (pid: 109678)... Jun 30 10:39:08.933014 dv-cinder-822822-2-iscsi devstack@n-api.service[109679]: Gracefully killing worker 2 (pid: 109679)... Jun 30 10:39:09.933717 dv-cinder-822822-2-iscsi devstack@n-api.service[109677]: worker 1 buried after 1 seconds Jun 30 10:39:09.934126 dv-cinder-822822-2-iscsi devstack@n-api.service[109677]: worker 2 buried after 1 seconds Jun 30 10:39:09.934126 dv-cinder-822822-2-iscsi devstack@n-api.service[109677]: goodbye to uWSGI. Jun 30 10:39:09.935220 dv-cinder-822822-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 30 10:39:09.935787 dv-cinder-822822-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 30 10:39:09.938646 dv-cinder-822822-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 30 10:39:09.948084 dv-cinder-822822-2-iscsi devstack@n-api.service[124186]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 30 10:39:09.950228 dv-cinder-822822-2-iscsi devstack@n-api.service[124186]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 30 10:39:09 2022] *** Jun 30 10:39:09.950228 dv-cinder-822822-2-iscsi devstack@n-api.service[124186]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 30 10:39:09.950228 dv-cinder-822822-2-iscsi devstack@n-api.service[124186]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 30 10:39:09.950228 dv-cinder-822822-2-iscsi devstack@n-api.service[124186]: nodename: dv-cinder-822822-2-iscsi Jun 30 10:39:09.950228 dv-cinder-822822-2-iscsi devstack@n-api.service[124186]: machine: x86_64 Jun 30 10:39:09.950228 dv-cinder-822822-2-iscsi devstack@n-api.service[124186]: clock source: unix Jun 30 10:39:09.950228 dv-cinder-822822-2-iscsi devstack@n-api.service[124186]: pcre jit disabled Jun 30 10:39:09.950228 dv-cinder-822822-2-iscsi devstack@n-api.service[124186]: detected number of CPU cores: 4 Jun 30 10:39:09.950228 dv-cinder-822822-2-iscsi devstack@n-api.service[124186]: current working directory: / Jun 30 10:39:09.950228 dv-cinder-822822-2-iscsi devstack@n-api.service[124186]: detected binary path: /usr/bin/uwsgi-core Jun 30 10:39:09.950228 dv-cinder-822822-2-iscsi devstack@n-api.service[124186]: your processes number limit is 47680 Jun 30 10:39:09.950947 dv-cinder-822822-2-iscsi devstack@n-api.service[124186]: your memory page size is 4096 bytes Jun 30 10:39:09.950947 dv-cinder-822822-2-iscsi devstack@n-api.service[124186]: detected max file descriptor number: 2048 Jun 30 10:39:09.950947 dv-cinder-822822-2-iscsi devstack@n-api.service[124186]: lock engine: pthread robust mutexes Jun 30 10:39:09.950947 dv-cinder-822822-2-iscsi devstack@n-api.service[124186]: thunder lock: enabled Jun 30 10:39:09.950947 dv-cinder-822822-2-iscsi devstack@n-api.service[124186]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 30 10:39:09.950947 dv-cinder-822822-2-iscsi devstack@n-api.service[124186]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 30 10:39:09.997193 dv-cinder-822822-2-iscsi devstack@n-api.service[124186]: Python main interpreter initialized at 0x56124a32d9c0 Jun 30 10:39:09.997193 dv-cinder-822822-2-iscsi devstack@n-api.service[124186]: python threads support enabled Jun 30 10:39:09.997193 dv-cinder-822822-2-iscsi devstack@n-api.service[124186]: your server socket listen backlog is limited to 100 connections Jun 30 10:39:09.997193 dv-cinder-822822-2-iscsi devstack@n-api.service[124186]: your mercy for graceful operations on workers is 90 seconds Jun 30 10:39:09.997704 dv-cinder-822822-2-iscsi devstack@n-api.service[124186]: mapped 403077 bytes (393 KB) for 2 cores Jun 30 10:39:09.997704 dv-cinder-822822-2-iscsi devstack@n-api.service[124186]: *** Operational MODE: preforking *** Jun 30 10:39:09.997923 dv-cinder-822822-2-iscsi devstack@n-api.service[124186]: *** uWSGI is running in multiple interpreter mode *** Jun 30 10:39:09.997923 dv-cinder-822822-2-iscsi devstack@n-api.service[124186]: spawned uWSGI master process (pid: 124186) Jun 30 10:39:09.998129 dv-cinder-822822-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 30 10:39:09.998709 dv-cinder-822822-2-iscsi devstack@n-api.service[124186]: spawned uWSGI worker 1 (pid: 124203, cores: 1) Jun 30 10:39:10.004785 dv-cinder-822822-2-iscsi devstack@n-api.service[124186]: spawned uWSGI worker 2 (pid: 124204, cores: 1) Jun 30 10:39:10.004785 dv-cinder-822822-2-iscsi devstack@n-api.service[124186]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 30 10:39:10.653980 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 30 10:39:10.665767 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 30 10:39:11.856988 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 10:39:11.856988 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: from cryptography.utils import int_from_bytes Jun 30 10:39:11.857615 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 10:39:11.857615 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: from cryptography.utils import int_from_bytes Jun 30 10:39:11.882303 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 10:39:11.882303 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: from cryptography.utils import int_from_bytes Jun 30 10:39:11.882861 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 10:39:11.882861 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: from cryptography.utils import int_from_bytes Jun 30 10:39:14.293339 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 30 10:39:14.293913 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 30 10:39:14.294143 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 30 10:39:14.294493 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 30 10:39:14.294750 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 30 10:39:14.295139 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.295464 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.295788 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.296352 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.296961 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.297451 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.297968 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.298509 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.299028 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.299440 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.299641 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 30 10:39:14.300022 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 30 10:39:14.300096 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.300417 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 30 10:39:14.300675 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-822822-2-iscsi {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.300824 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 30 10:39:14.300950 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.301064 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 30 10:39:14.301293 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.301431 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.301551 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.301761 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.301897 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.302009 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.302138 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.302382 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.302526 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.302641 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.302852 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.302984 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.303249 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.303393 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.303622 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.304900 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.304900 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.305476 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.305822 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.306097 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.306424 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-822822-2-iscsi {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.306424 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.307017 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.307283 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.307591 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.307884 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.308090 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.309374 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.309489 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.309568 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.309731 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.309809 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.309891 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.309987 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.310080 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.310173 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.310294 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.310384 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.310469 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-822822-2-iscsi {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.310554 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.310554 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.310554 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.310815 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.310907 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.310999 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.311084 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.311182 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.311277 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.311372 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.311469 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.311565 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.311651 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.311651 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.311824 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.311824 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.311988 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-822822-2-iscsi {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.312083 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.312183 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.312275 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.312367 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.312367 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.312580 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.312702 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.312807 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.312901 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.312901 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.313069 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.313155 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.313239 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.313348 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.313444 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.313530 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.313615 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.313817 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.314059 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.314243 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.314421 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.314528 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.314612 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.314765 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.314929 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.315084 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.315399 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.315494 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.315725 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.315821 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.316034 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.316136 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.316358 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.316467 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.316634 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.316782 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.316981 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.317177 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.317286 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.317505 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.317668 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.317827 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.317968 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.318119 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.318265 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.318407 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.318561 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.318717 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.318866 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.319015 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.319165 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.319306 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.319461 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.319613 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.319766 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.319908 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.320056 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.320211 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.320361 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.320544 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.320693 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.320837 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.320992 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.321147 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.321289 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.321437 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.321584 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.321734 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.321884 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.322042 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.322195 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.59 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.322344 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.322495 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.59 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.322644 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.322796 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.322955 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.323097 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.323246 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.323396 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.323537 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.323688 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.323836 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.59 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.323986 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.324135 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.59 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.324294 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.324435 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.324615 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.324766 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.324917 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.325067 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.325218 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.325370 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.325521 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.325669 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.325818 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.325970 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.326126 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.326278 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.326438 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.326582 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.326723 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.326864 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.327005 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.327153 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.327304 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.327445 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.327585 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.327734 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.327876 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.328025 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.328183 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.328325 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.328473 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.328640 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.328792 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.328949 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.329102 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.329245 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.329386 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.330035 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.330255 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.330413 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.330562 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.330714 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.330856 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.331004 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.331154 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.331309 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.331451 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.331599 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.331748 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.331897 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.332058 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.332212 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.332212 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.332481 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.332679 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.332822 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.332974 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.333125 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.333273 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.333423 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.333565 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.333719 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.333862 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.334003 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.334151 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.334360 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.334523 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.334665 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.334813 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.334960 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.335110 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.335252 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.335393 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.335542 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.335692 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.335839 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.335989 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.336130 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.336277 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.336440 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.336626 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.336779 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.336930 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.337079 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.337221 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.337376 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.337518 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.337660 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.337808 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.337958 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.338107 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.338258 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.338423 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.338573 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.338716 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.338857 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.339005 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.339160 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.339312 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.339454 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.339596 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.339737 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.339889 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.340040 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.340182 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.340341 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.340484 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.340706 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.340851 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.341003 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.341146 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.341287 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.341427 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.341576 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.341731 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.341873 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.342028 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.342180 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.342339 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.342481 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.342631 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.342780 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.342930 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.343072 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.343220 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.343362 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.343512 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:39:14.343654 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.343804 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.343947 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.344104 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.344259 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.344408 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.344576 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.344724 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.344866 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.345007 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.345167 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.345856 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.346014 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.346163 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.346313 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.346472 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.346628 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.347355 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.347512 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.347655 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.347798 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.347958 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.348253 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.348425 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.348631 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.348796 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.348952 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.349095 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.349256 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.349413 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.349563 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.349713 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.349855 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.350002 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.350154 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.350298 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.350446 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.350595 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.350737 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.350886 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.351037 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.351195 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.351340 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.351481 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.351622 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.351762 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.351911 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.352064 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.352206 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.352356 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.352514 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.352675 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.352828 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.352980 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.353122 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.353262 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.353405 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.353558 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.353712 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.354708 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.354871 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.355014 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.355014 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.355292 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.355292 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.355574 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.355735 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.355885 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.356028 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.356178 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.356327 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.356472 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.356660 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.356813 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.356813 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.357092 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.357235 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.357377 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.357527 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.357687 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.357844 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.357987 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.358128 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.358276 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.358424 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.358568 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.358728 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.358879 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.359031 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.359173 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.359173 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.359440 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.359604 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.359820 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.359985 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.360130 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.360272 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.360420 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.360420 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.360735 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.360909 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.361052 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.361194 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.361335 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.361553 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.361714 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.361858 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.362006 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.362157 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.362308 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.362451 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.362599 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.362756 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.362906 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.363056 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.363207 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.363349 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.363507 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.363650 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.363800 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.363949 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.364100 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.364243 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.364390 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.364566 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.364716 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.364859 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.365016 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.365167 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.365309 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.365468 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.365618 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.365768 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.365911 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.366052 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.366200 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.366349 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.366490 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.366644 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.366795 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.366949 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.367098 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.367827 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.367984 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.368143 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.368286 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.368442 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.368611 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.368766 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.368915 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.369292 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.369445 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.369597 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.369748 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.369908 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.370058 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.370209 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.370359 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.370510 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.370654 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.370804 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.370946 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.371087 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.371237 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.371393 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.371536 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.371695 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.371845 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.372006 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.372293 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.372466 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.372634 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.372788 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.372938 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.373080 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.373235 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.373387 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.373542 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.373691 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.373844 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.373993 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.374144 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.374296 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.374448 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.374590 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.374732 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.374874 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.375024 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.375174 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.375325 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.375468 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.375609 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.375769 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.375921 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.376071 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.376214 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.376354 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.376575 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.377304 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.377460 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.377613 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.377757 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.377908 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.378059 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.378217 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.378380 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.378531 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.378682 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.378832 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.378982 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.379147 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.379298 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.379449 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.379592 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.379742 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.379894 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.380047 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.380189 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.380341 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.380482 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.380713 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.381101 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.381249 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.381406 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.381555 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.381652 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.381732 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.381831 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.381929 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.382022 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.382114 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.382982 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.383079 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.383174 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.383269 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.383361 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.383446 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.383530 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.383622 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.383715 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.383801 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.383801 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.383801 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.383801 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.384119 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.384206 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.384206 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.384371 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.384455 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.384565 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.384664 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.384757 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.384850 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.384940 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.385032 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.385116 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.385212 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.385305 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.385390 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.385480 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.385565 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.385648 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.385741 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.385827 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.385917 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.386008 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.386092 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.386188 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.386279 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.386279 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.386440 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.386576 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.386669 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.386896 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.386988 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.387203 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.387303 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.387516 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.387607 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.387847 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.387946 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.388182 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.388281 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.388491 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.388656 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.388826 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.388914 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.389134 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.389224 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.389448 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.389547 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.389763 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.389854 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.390074 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.390172 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.390379 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.390485 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.390690 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.390787 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.391006 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.391130 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.391330 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.391634 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.391751 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.391947 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.392732 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.392892 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.393026 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.393166 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.393307 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.393437 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.393573 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.393743 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.393889 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.394050 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.394213 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.394363 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.394497 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.394687 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.394829 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.394996 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.395128 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.395319 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.395458 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.395641 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.395783 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.395946 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.396078 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.396252 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.396386 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.396597 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.396750 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.396909 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.397042 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.397214 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.397347 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.397518 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.397664 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.397821 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.397961 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.398170 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.398302 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.398483 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.398623 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.398788 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.398920 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.399105 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.399244 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.399427 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.399568 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.399736 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.399874 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.400053 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.400184 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.400364 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.400497 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.400696 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.400919 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.401063 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.401360 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.401639 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.401859 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.402000 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.402130 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.402258 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.402400 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.402537 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.402667 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.402803 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.402939 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.403076 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.403214 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.403352 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.403481 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.403615 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.403746 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.403874 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.404004 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.404131 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.404296 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.404428 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.404668 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.404826 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.404971 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.405109 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.405285 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.405499 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.405639 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.405832 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.405966 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.406189 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.406507 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.406617 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.406853 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.406970 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.407176 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.407276 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.407506 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.407622 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.408404 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.408538 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.408762 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.408862 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.409111 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.409225 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.409419 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.409517 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.409728 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.409834 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.410036 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.410145 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.410346 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.410455 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.410651 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.410750 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.410956 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.411064 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.411270 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.411397 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.411618 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.411719 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.411936 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.412039 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.412255 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.412401 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.412602 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.412702 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.412922 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.413017 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.413236 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.413346 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.413555 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.413663 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.413874 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.413980 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.414203 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.414319 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.414534 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.414645 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.414857 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.414968 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.415174 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.415277 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.415473 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.415581 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.415776 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.415878 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.416114 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.416242 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.416427 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.416569 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.416767 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.416903 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.417122 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.417225 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.417437 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.417563 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.417794 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.417895 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.418134 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.418233 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.418472 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.418562 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.418778 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.418883 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.419084 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.419184 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.419389 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.419489 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.419698 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.419848 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.420007 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.420099 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.420313 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.420419 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.420669 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.420786 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.420982 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.421082 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.421297 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.421412 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.421608 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.421720 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.421907 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.422005 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.422215 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.422307 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.422519 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.422615 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.422836 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.422977 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.423142 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.423243 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.423473 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.423569 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.423777 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.423870 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.424087 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.424187 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.424400 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.424527 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.424726 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.424817 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.425037 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.425141 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.425342 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.425437 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.425653 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.425747 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.425957 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.426061 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.426261 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.426361 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.426565 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.426665 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.426872 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.427042 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.427179 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.427273 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.427483 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.427577 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.427806 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.427912 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.428112 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.428203 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.428413 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.428534 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.428740 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.428835 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.429047 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.429147 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.429349 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.429449 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.429650 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.429743 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.429957 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.430057 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.430270 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.430374 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.430581 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.430674 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.430881 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.430973 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.431191 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.431285 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.431493 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.431587 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.431796 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.431895 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.432098 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.432199 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.432403 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.432649 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.432758 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.432847 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.433018 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.433125 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.433321 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.433417 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.433622 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.433714 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.433924 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.434026 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.434233 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.434333 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.434540 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.434674 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.434840 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.434943 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.435144 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.435238 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.435443 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.435535 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.435768 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.435860 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.436080 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.436181 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.436388 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.436486 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.436762 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.436862 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.437079 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.437170 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.437398 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.437496 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.437708 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.437802 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.438017 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.438108 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.438331 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.438431 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.438636 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.438730 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.438973 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.439075 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.439283 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.439389 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.439594 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.439687 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.439898 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.439989 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.440201 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.440308 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.440542 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.440650 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.440855 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.440956 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.441164 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.441270 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.441490 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.441590 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.441805 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.441904 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.442130 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.442256 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.442439 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.442546 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.442756 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.442852 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.443039 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.443147 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.443344 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.443437 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.443651 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.443752 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.443957 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.444058 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.444264 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.444356 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.444594 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.444691 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.444906 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.445003 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.445213 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.445306 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.445524 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.445618 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.445830 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.445931 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.446139 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.446238 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.446445 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.446544 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.446749 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.446850 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.447066 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.447157 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.447371 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.447471 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.447719 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.447820 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.447987 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.448080 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.448288 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.448395 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.448616 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.448731 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.448922 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.449021 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.449244 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.449349 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.449561 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.449654 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.449877 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.449970 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.450242 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.450335 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.450549 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.450649 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.450857 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.450957 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.451174 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.451268 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.451490 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.451589 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.451795 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.451889 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.452130 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.452224 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.452483 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.452765 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.452849 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.452938 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.453129 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.453227 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.453476 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.453578 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.453737 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.453847 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.454044 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.454166 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.454367 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.454483 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.455185 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.455315 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.455492 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.455635 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.455795 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.455968 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.456119 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.456294 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.456423 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.456690 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.456862 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.457009 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.457281 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.457383 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.457592 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.457691 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.457895 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.457995 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.458309 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.458412 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.458621 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.458714 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.458930 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.459030 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.459255 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.459391 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.459577 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.459710 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.459901 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.460110 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.460219 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.460346 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.460546 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.460703 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.460836 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.461040 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.461161 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.461355 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.461482 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.461679 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.461781 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.461996 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.462157 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.462329 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.462430 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.462662 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.462783 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.463026 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.463129 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.463291 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.463385 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.463608 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.463736 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.463943 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.464047 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.464272 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.464373 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.464636 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.464746 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.464959 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.465051 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.465286 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.465429 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.465593 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.465898 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.466207 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.466510 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.466812 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.467124 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.467230 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.467428 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.467520 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.467735 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.467834 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.468043 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.468189 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.468350 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.468465 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.468677 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.468817 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.468980 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.469146 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.469302 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.469469 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.469606 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.469791 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.469928 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.470130 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.470861 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.471003 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.471188 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.471330 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.471508 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.471654 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.471820 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.471975 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.472143 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.472295 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.472451 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.472637 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.472777 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.473016 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.473130 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.473288 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.473389 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.473624 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.473785 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.473950 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.474088 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.474286 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.474381 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.474615 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.474706 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.474930 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.475029 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.475242 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.475378 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.475570 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.475662 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.475887 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.475988 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.476198 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.476291 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.476545 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.476640 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.476855 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.476958 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.477163 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.477270 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.477468 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.477561 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.477775 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.477878 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.478078 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.478171 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.478382 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.478474 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.478687 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.478789 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.478993 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.479402 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.479576 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.479729 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.479896 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.480058 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.480153 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.480396 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.480495 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.480749 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.480858 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.481066 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.481166 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.481388 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.481482 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.481688 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.481795 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.481996 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.482095 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.482295 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.482443 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.482612 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.482717 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.482925 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.483018 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.483242 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.483355 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.483555 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.483656 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.483873 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.483971 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.484190 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.484288 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.484493 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.484708 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.484843 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.484936 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.485158 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.485250 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.485473 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.485567 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.485808 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.485914 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.486136 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.486228 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.486451 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.486544 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.486764 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.486856 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.487077 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.487175 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.487384 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.487476 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.487696 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.487787 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.488006 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.488110 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.488321 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.488458 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.488729 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.488881 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.489053 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.489206 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.489374 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.489519 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.489696 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.489830 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.490017 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.490140 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.490341 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.490440 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.490663 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.490763 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.490980 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.491082 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.491301 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.491402 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.491621 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.491724 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.491933 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.492072 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.492261 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.492478 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.492663 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.492855 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.492962 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.493182 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.493405 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.493509 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.493597 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.493816 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.493919 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.494138 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.494267 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.494451 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.494543 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.494768 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.494861 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.495086 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.495179 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.495397 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.495497 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.495709 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.495846 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.496024 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.496124 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.496338 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.496449 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.496670 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.496765 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.496979 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.497072 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.497290 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.497402 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.497601 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.497694 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.497910 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.498004 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.498218 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.498320 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.498530 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.498631 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.498843 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.498937 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.499166 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.499260 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.499499 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.499592 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.499816 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.499916 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.500128 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.500232 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.500440 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.500565 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.500780 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.500884 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.501098 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.501295 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.501438 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.501632 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.501760 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.501970 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.502063 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.502294 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.502386 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.502617 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.502710 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.502934 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.503035 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.503249 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.503411 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.503577 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.503669 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.503883 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.503976 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.504185 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.504285 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.504491 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.504643 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.504821 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.505115 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.505209 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.505433 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.505531 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.505742 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.505881 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.506043 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.506172 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.506361 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.506465 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.506669 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.506761 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.507035 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.507200 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.507370 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.507552 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.507685 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.507872 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.508000 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.508200 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.508322 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.508545 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.508685 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.508913 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.509013 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.509181 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.509273 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.509509 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.509605 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.509818 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.509918 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.510126 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.510219 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.510443 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.510535 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.510755 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.511038 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.511130 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.511353 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.511445 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.511663 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.511756 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.511976 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.512068 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.512281 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.512374 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.512614 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.512769 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.512922 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.513015 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.513245 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.513338 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.513556 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.513674 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.513866 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.513971 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.514170 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.514303 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.514480 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.514573 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.514782 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.514889 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.515086 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.515182 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.515389 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.515489 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.515692 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.515836 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.516002 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.516094 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.516306 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.516452 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.516688 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.516792 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.517520 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.517622 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.517853 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.517954 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.518170 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.518272 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.518485 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.518585 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.518810 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.518909 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.519123 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.519224 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.519436 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.519530 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.519737 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.519836 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.520048 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.520141 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.520353 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.520444 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.520694 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.520788 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.521001 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.521095 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.521309 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.521401 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.521623 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.521751 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.521936 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.522058 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.522252 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.522475 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.522608 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.522811 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.522942 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.523130 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.523255 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.523462 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.523582 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.523795 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.523896 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.524085 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.524186 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.524389 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.524482 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.524720 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.524818 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.525044 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.525137 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.525353 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.525447 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.525661 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.525755 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.525972 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.526281 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.526373 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.526589 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.526719 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.526895 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.526987 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.527202 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.527294 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.527510 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.527604 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.527815 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.527916 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.528122 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.528222 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.528429 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.528557 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.528762 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.528855 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.529071 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.529172 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.529387 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.529482 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.529725 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.529823 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.530041 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.530142 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.530354 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.530454 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.530667 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.530759 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.530981 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.531082 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.531289 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.531387 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.531600 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.531694 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.531910 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.532011 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.532222 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.532320 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.532552 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.532648 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.533419 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.533523 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.533757 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.533860 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.534078 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.534181 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.534413 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.534572 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.534737 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.534886 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.535061 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.535203 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.535386 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.535520 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.535707 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.535829 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.536027 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.536155 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.536347 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.536477 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.536690 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.536808 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.537012 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.537123 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.537354 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.537448 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.537677 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.537769 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.537991 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.538098 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.538377 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.538500 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.538704 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.538827 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.539011 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.539153 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.539316 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.539480 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.539618 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.539798 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.539969 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.540132 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.540226 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.540464 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.540594 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.540807 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.540916 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.541125 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.541224 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.541433 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.541533 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.541733 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.541834 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.542035 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.542129 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.542344 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.542426 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.542648 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.542747 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.542953 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.543052 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.543255 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.543348 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.543557 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.543650 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.543857 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.544003 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.544163 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.544281 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.544467 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.544632 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.544781 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.544924 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.545085 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.545190 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.545384 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.545476 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.545686 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.545793 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.545986 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.546132 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.546286 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.546387 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.546586 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.546679 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.546915 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.547018 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.547247 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.547348 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.547555 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.547653 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.547866 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.547969 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.548171 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.548262 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.548606 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.548715 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.548834 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.548925 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.549146 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.549246 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.549455 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.549555 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.549765 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.549859 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.550072 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.550164 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.550380 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.550471 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.550692 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.550792 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.550996 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.551088 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.551305 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.551404 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.551614 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.551707 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.551921 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.552022 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.552232 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.552334 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.552579 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.552689 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.552905 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.552998 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.553209 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.553316 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.553534 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.553665 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.553850 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.553944 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.554165 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.554282 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.554477 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.554588 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.554780 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.554882 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.555106 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.555219 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.555411 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.555510 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.555718 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.555811 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.556031 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.556122 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.556335 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.556433 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.556664 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.556759 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.556978 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.557118 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.557289 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.557389 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.557614 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.557714 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.557939 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.558032 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.558245 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.558337 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.558571 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.558676 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.558890 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.558984 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.559226 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.559319 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.559535 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.559635 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.559848 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.559947 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.560169 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.560262 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.560484 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.560613 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.560815 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.560909 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.561121 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.561221 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.561363 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 30 10:39:14.561464 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.561760 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.562096 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.562412 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.562748 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.563082 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.563432 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.563753 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.564692 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.565028 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.565352 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.565671 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.565985 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:39:14.566232 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 30 10:39:14.625469 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO dbcounter [None req-e7eabd70-2c1e-4265-a88e-6490d45506d8 None None] Registered counter for database nova_api Jun 30 10:39:14.629551 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO dbcounter [None req-62a80ac8-0045-4f6e-8889-369fced56ffe None None] Registered counter for database nova_api Jun 30 10:39:14.646642 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_db.sqlalchemy.engines [None req-e7eabd70-2c1e-4265-a88e-6490d45506d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124204) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 10:39:14.649742 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_db.sqlalchemy.engines [None req-62a80ac8-0045-4f6e-8889-369fced56ffe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124203) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 10:39:14.655005 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writer thread running {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 10:39:14.656231 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writer thread running {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 10:39:14.710838 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.context [None req-e7eabd70-2c1e-4265-a88e-6490d45506d8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),426e332d-fd0b-425e-9da3-ae65045e8059(cell1) {{(pid=124204) load_cells /opt/stack/nova/nova/context.py:464}} Jun 30 10:39:14.712852 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.context [None req-62a80ac8-0045-4f6e-8889-369fced56ffe None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),426e332d-fd0b-425e-9da3-ae65045e8059(cell1) {{(pid=124203) load_cells /opt/stack/nova/nova/context.py:464}} Jun 30 10:39:14.714922 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-e7eabd70-2c1e-4265-a88e-6490d45506d8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:39:14.716484 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-e7eabd70-2c1e-4265-a88e-6490d45506d8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:39:14.716915 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-62a80ac8-0045-4f6e-8889-369fced56ffe None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:39:14.717285 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-e7eabd70-2c1e-4265-a88e-6490d45506d8 None None] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:39:14.718514 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-62a80ac8-0045-4f6e-8889-369fced56ffe None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:39:14.719311 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-62a80ac8-0045-4f6e-8889-369fced56ffe None None] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:39:14.719422 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-e7eabd70-2c1e-4265-a88e-6490d45506d8 None None] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:39:14.721363 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO dbcounter [None req-e7eabd70-2c1e-4265-a88e-6490d45506d8 None None] Registered counter for database nova_cell0 Jun 30 10:39:14.721486 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-62a80ac8-0045-4f6e-8889-369fced56ffe None None] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:39:14.723342 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO dbcounter [None req-62a80ac8-0045-4f6e-8889-369fced56ffe None None] Registered counter for database nova_cell0 Jun 30 10:39:14.725408 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO dbcounter [None req-e7eabd70-2c1e-4265-a88e-6490d45506d8 None None] Registered counter for database nova_cell1 Jun 30 10:39:14.727512 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO dbcounter [None req-62a80ac8-0045-4f6e-8889-369fced56ffe None None] Registered counter for database nova_cell1 Jun 30 10:39:14.733447 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_db.sqlalchemy.engines [None req-e7eabd70-2c1e-4265-a88e-6490d45506d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124204) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 10:39:14.735682 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_db.sqlalchemy.engines [None req-e7eabd70-2c1e-4265-a88e-6490d45506d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124204) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 10:39:14.735864 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_db.sqlalchemy.engines [None req-62a80ac8-0045-4f6e-8889-369fced56ffe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124203) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 10:39:14.737628 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_db.sqlalchemy.engines [None req-62a80ac8-0045-4f6e-8889-369fced56ffe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124203) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 10:39:14.742745 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writer thread running {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 10:39:14.743332 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writer thread running {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 10:39:14.743666 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writer thread running {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 10:39:14.885270 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writer thread running {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 10:39:14.893127 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO dbcounter [None req-e7eabd70-2c1e-4265-a88e-6490d45506d8 None None] Registered counter for database nova_cell0 Jun 30 10:39:14.896204 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO dbcounter [None req-62a80ac8-0045-4f6e-8889-369fced56ffe None None] Registered counter for database nova_cell0 Jun 30 10:39:14.901553 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_db.sqlalchemy.engines [None req-e7eabd70-2c1e-4265-a88e-6490d45506d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124204) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 10:39:14.903480 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_db.sqlalchemy.engines [None req-62a80ac8-0045-4f6e-8889-369fced56ffe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124203) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 10:39:14.906821 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writer thread running {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 10:39:14.910091 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writer thread running {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 10:39:15.235448 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: WARNING keystonemiddleware.auth_token [None req-e7eabd70-2c1e-4265-a88e-6490d45506d8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 30 10:39:15.238777 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: WARNING keystonemiddleware.auth_token [None req-62a80ac8-0045-4f6e-8889-369fced56ffe None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 30 10:39:15.243022 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: WARNING keystonemiddleware.auth_token [None req-e7eabd70-2c1e-4265-a88e-6490d45506d8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 30 10:39:15.246039 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: WARNING keystonemiddleware.auth_token [None req-62a80ac8-0045-4f6e-8889-369fced56ffe None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 30 10:39:15.588693 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: WARNING keystonemiddleware.auth_token [None req-62a80ac8-0045-4f6e-8889-369fced56ffe None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 30 10:39:15.590832 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: WARNING keystonemiddleware.auth_token [None req-e7eabd70-2c1e-4265-a88e-6490d45506d8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 30 10:39:15.594647 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: WARNING keystonemiddleware.auth_token [None req-62a80ac8-0045-4f6e-8889-369fced56ffe None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 30 10:39:15.596837 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: WARNING keystonemiddleware.auth_token [None req-e7eabd70-2c1e-4265-a88e-6490d45506d8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 30 10:39:15.600048 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56124a32d9c0 pid: 124203 (default app) Jun 30 10:39:15.602298 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56124a32d9c0 pid: 124204 (default app) Jun 30 10:39:57.417054 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_api:SELECT=3 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:39:57.418485 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_cell0:SELECT=3 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:39:57.419406 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_cell1:SELECT=3 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:39:57.420602 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_cell0:SELECT=3 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:39:58.619034 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-31ea3d46-e8bf-473a-b806-46be0e2bf512 tempest-VolumesGetTestJSON-1934463111 tempest-VolumesGetTestJSON-1934463111-project] Action: 'create', calling method: .version_select at 0x7f4dafd563a0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-383356738", "metadata": {"Type": "work"}}} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:40:00.370598 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-31ea3d46-e8bf-473a-b806-46be0e2bf512 tempest-VolumesGetTestJSON-1934463111 tempest-VolumesGetTestJSON-1934463111-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.959000 Jun 30 10:40:00.373592 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 1/1] 10.222.0.59 () {60 vars in 1155 bytes} [Thu Jun 30 10:39:57 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 2964 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 30 10:40:00.387131 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_api:SELECT=3 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:00.387943 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_cell0:SELECT=3 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:00.388736 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_cell1:SELECT=3 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:00.389602 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_cell0:SELECT=3 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:00.831523 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-ff195773-524d-41bf-a925-959654c48883 tempest-VolumesGetTestJSON-1934463111 tempest-VolumesGetTestJSON-1934463111-project] Calling method '.version_select at 0x7f4dafe0e940>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:01.528721 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-ff195773-524d-41bf-a925-959654c48883 tempest-VolumesGetTestJSON-1934463111 tempest-VolumesGetTestJSON-1934463111-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/3c3e656d-f505-4b17-b5c8-a1e2825481db" status: 200 len: 352 microversion: 2.1 time: 1.146539 Jun 30 10:40:01.529806 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 1/2] 10.222.0.59 () {58 vars in 1244 bytes} [Thu Jun 30 10:40:00 2022] GET /compute/v2.1/os-volumes/3c3e656d-f505-4b17-b5c8-a1e2825481db => generated 352 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:40:02.542558 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-b24bd6a7-41fb-4f42-8bf3-52271838d527 tempest-VolumesGetTestJSON-1934463111 tempest-VolumesGetTestJSON-1934463111-project] Calling method '.version_select at 0x7f4dafc2b280>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:02.598712 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-b24bd6a7-41fb-4f42-8bf3-52271838d527 tempest-VolumesGetTestJSON-1934463111 tempest-VolumesGetTestJSON-1934463111-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/3c3e656d-f505-4b17-b5c8-a1e2825481db" status: 200 len: 353 microversion: 2.1 time: 0.060658 Jun 30 10:40:02.599990 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 2/3] 10.222.0.59 () {58 vars in 1244 bytes} [Thu Jun 30 10:40:02 2022] GET /compute/v2.1/os-volumes/3c3e656d-f505-4b17-b5c8-a1e2825481db => generated 353 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:40:02.613331 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-49c687fe-7ebe-4c6c-8934-12f3bc2d8e2f tempest-VolumesGetTestJSON-1934463111 tempest-VolumesGetTestJSON-1934463111-project] Calling method '.version_select at 0x7f4dafc1a280>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:02.678020 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-49c687fe-7ebe-4c6c-8934-12f3bc2d8e2f tempest-VolumesGetTestJSON-1934463111 tempest-VolumesGetTestJSON-1934463111-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/3c3e656d-f505-4b17-b5c8-a1e2825481db" status: 200 len: 353 microversion: 2.1 time: 0.070437 Jun 30 10:40:02.679230 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 2/4] 10.222.0.59 () {58 vars in 1244 bytes} [Thu Jun 30 10:40:02 2022] GET /compute/v2.1/os-volumes/3c3e656d-f505-4b17-b5c8-a1e2825481db => generated 353 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 10:40:02.696495 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-7d294b1e-a6cb-4790-87fd-b5b8e3280eee tempest-VolumesGetTestJSON-1934463111 tempest-VolumesGetTestJSON-1934463111-project] Calling method '.version_select at 0x7f4dafc2b4c0>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:02.810595 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-7d294b1e-a6cb-4790-87fd-b5b8e3280eee tempest-VolumesGetTestJSON-1934463111 tempest-VolumesGetTestJSON-1934463111-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/3c3e656d-f505-4b17-b5c8-a1e2825481db" status: 202 len: 0 microversion: 2.1 time: 0.115536 Jun 30 10:40:02.812903 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 3/5] 10.222.0.59 () {58 vars in 1247 bytes} [Thu Jun 30 10:40:02 2022] DELETE /compute/v2.1/os-volumes/3c3e656d-f505-4b17-b5c8-a1e2825481db => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 10:40:02.822242 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-bc0c782f-5fef-41e6-9921-65d6350158a4 tempest-VolumesGetTestJSON-1934463111 tempest-VolumesGetTestJSON-1934463111-project] Calling method '.version_select at 0x7f4dafc1a940>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:02.946580 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-bc0c782f-5fef-41e6-9921-65d6350158a4 tempest-VolumesGetTestJSON-1934463111 tempest-VolumesGetTestJSON-1934463111-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/3c3e656d-f505-4b17-b5c8-a1e2825481db" status: 200 len: 352 microversion: 2.1 time: 0.128641 Jun 30 10:40:02.947415 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 3/6] 10.222.0.59 () {58 vars in 1244 bytes} [Thu Jun 30 10:40:02 2022] GET /compute/v2.1/os-volumes/3c3e656d-f505-4b17-b5c8-a1e2825481db => generated 352 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:40:03.959855 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-dcaaa531-7cb5-49cd-901c-bab0f20da0c9 tempest-VolumesGetTestJSON-1934463111 tempest-VolumesGetTestJSON-1934463111-project] Calling method '.version_select at 0x7f4dafc2b9d0>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:04.017359 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.wsgi [None req-dcaaa531-7cb5-49cd-901c-bab0f20da0c9 tempest-VolumesGetTestJSON-1934463111 tempest-VolumesGetTestJSON-1934463111-project] HTTP exception thrown: Volume 3c3e656d-f505-4b17-b5c8-a1e2825481db could not be found. Jun 30 10:40:04.022082 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-dcaaa531-7cb5-49cd-901c-bab0f20da0c9 tempest-VolumesGetTestJSON-1934463111 tempest-VolumesGetTestJSON-1934463111-project] Request method failure captured: Jun 30 10:40:04.022082 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: request: GET /compute/v2.1/os-volumes/3c3e656d-f505-4b17-b5c8-a1e2825481db HTTP/1.1 Jun 30 10:40:04.022082 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Accept: application/json Jun 30 10:40:04.022082 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Accept-Encoding: identity Jun 30 10:40:04.022082 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Connection: close Jun 30 10:40:04.022082 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Content-Length: 0 Jun 30 10:40:04.022082 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Content-Type: application/json Jun 30 10:40:04.022082 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Host: 10.222.0.59 Jun 30 10:40:04.022082 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Openstack-System-Scope: None Jun 30 10:40:04.022082 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: User-Agent: python-urllib3/1.26.9 Jun 30 10:40:04.022082 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Auth-Token: gAAAAABivX19CpobfoGdC20nxojKXhcSWuBX-00Hpkoe2iG_JpZg0AQ6uwyONPMAoUbV1NsYXUMImGcu1fWPU4HP6ZeuwWAcYMSxgRu8etlkmAfuDPOseHLxi4OLi9Obw4US183pcZvFa-Tl268CyKk35zEVKWZLDvEZGpIEeqAeINs_z6VaVE8 Jun 30 10:40:04.022082 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Domain-Id: None Jun 30 10:40:04.022082 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Domain-Name: None Jun 30 10:40:04.022082 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Identity-Status: Confirmed Jun 30 10:40:04.022082 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Is-Admin-Project: True Jun 30 10:40:04.022082 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Domain-Id: default Jun 30 10:40:04.022082 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Domain-Name: Default Jun 30 10:40:04.022082 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Id: a3eeea32558849058212b9e4b7978856 Jun 30 10:40:04.022082 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Name: tempest-VolumesGetTestJSON-1934463111 Jun 30 10:40:04.022082 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Role: member,reader Jun 30 10:40:04.022082 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Roles: member,reader Jun 30 10:40:04.023289 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/a3eeea32558849058212b9e4b7978856"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_a3eeea32558849058212b9e4b7978856"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a3eeea32558849058212b9e4b7978856"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a3eeea32558849058212b9e4b7978856"}]}] Jun 30 10:40:04.023289 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant: tempest-VolumesGetTestJSON-1934463111 Jun 30 10:40:04.023289 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant-Id: a3eeea32558849058212b9e4b7978856 Jun 30 10:40:04.023289 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant-Name: tempest-VolumesGetTestJSON-1934463111 Jun 30 10:40:04.023289 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User: tempest-VolumesGetTestJSON-1934463111-project Jun 30 10:40:04.023289 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Domain-Id: default Jun 30 10:40:04.023289 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Domain-Name: Default Jun 30 10:40:04.023289 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Id: b09fbc020c6d43ea8e24da41d2eeadb6 Jun 30 10:40:04.023289 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Name: tempest-VolumesGetTestJSON-1934463111-project Jun 30 10:40:04.023289 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: method: Jun 30 10:40:04.023289 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: exception: Volume 3c3e656d-f505-4b17-b5c8-a1e2825481db could not be found. Jun 30 10:40:04.023289 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: action_args: {'id': '3c3e656d-f505-4b17-b5c8-a1e2825481db'} Jun 30 10:40:04.023289 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:40:04.024037 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:40:04.024037 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 10:40:04.024037 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 10:40:04.024037 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 30 10:40:04.024037 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 30 10:40:04.024037 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 30 10:40:04.024037 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 30 10:40:04.024037 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 10:40:04.024037 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 10:40:04.024037 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 10:40:04.024037 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 10:40:04.024037 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 10:40:04.024037 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 10:40:04.024037 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 10:40:04.024037 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 10:40:04.024037 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3c3e656d-f505-4b17-b5c8-a1e2825481db could not be found. (HTTP 404) (Request-ID: req-7df87164-561b-4290-9679-b7948d69c12d) Jun 30 10:40:04.024037 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:40:04.024037 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:40:04.024037 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:40:04.025184 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:40:04.025184 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 30 10:40:04.025184 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 30 10:40:04.025184 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 30 10:40:04.025184 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 30 10:40:04.025184 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 30 10:40:04.025184 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 30 10:40:04.025184 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 30 10:40:04.025184 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 30 10:40:04.025184 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 10:40:04.025184 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 10:40:04.025184 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 30 10:40:04.025184 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 30 10:40:04.025184 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 30 10:40:04.025184 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 30 10:40:04.025184 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 10:40:04.025184 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 10:40:04.025184 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 10:40:04.025184 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 10:40:04.026260 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 10:40:04.026260 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 10:40:04.026260 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 10:40:04.026260 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 10:40:04.026260 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3c3e656d-f505-4b17-b5c8-a1e2825481db could not be found. Jun 30 10:40:04.026260 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:40:04.026260 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:40:04.026260 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:40:04.026260 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:40:04.026260 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:40:04.026260 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:40:04.026260 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:40:04.026260 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:40:04.026260 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 10:40:04.026260 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 10:40:04.026260 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:40:04.026260 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:40:04.026260 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 30 10:40:04.026260 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:40:04.027192 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3c3e656d-f505-4b17-b5c8-a1e2825481db could not be found. Jun 30 10:40:04.027192 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:40:04.027192 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:40:04.027192 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:40:04.027192 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:40:04.027192 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:40:04.027192 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:40:04.027192 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:40:04.027192 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:40:04.027192 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3c3e656d-f505-4b17-b5c8-a1e2825481db could not be found. Jun 30 10:40:04.027192 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:40:04.028862 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-dcaaa531-7cb5-49cd-901c-bab0f20da0c9 tempest-VolumesGetTestJSON-1934463111 tempest-VolumesGetTestJSON-1934463111-project] Returning 404 to user: Volume 3c3e656d-f505-4b17-b5c8-a1e2825481db could not be found. {{(pid=124203) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:40:04.029872 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-dcaaa531-7cb5-49cd-901c-bab0f20da0c9 tempest-VolumesGetTestJSON-1934463111 tempest-VolumesGetTestJSON-1934463111-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/3c3e656d-f505-4b17-b5c8-a1e2825481db" status: 404 len: 109 microversion: 2.1 time: 0.074627 Jun 30 10:40:04.033012 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 4/7] 10.222.0.59 () {58 vars in 1244 bytes} [Thu Jun 30 10:40:03 2022] GET /compute/v2.1/os-volumes/3c3e656d-f505-4b17-b5c8-a1e2825481db => generated 109 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 10:40:09.119391 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-6b75886e-85bc-4d5a-84b6-f4700b9a9f10 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-81616998", "imageRef": "c473bd04-5a45-4eb7-b6f4-2b5033d4fc1d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:40:09.332609 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.network.neutron [None req-6b75886e-85bc-4d5a-84b6-f4700b9a9f10 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] validate_networks() for [('8ad12fa2-834f-4c86-9669-8b937fe31721', None, None, None, None, None)] {{(pid=124204) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 10:40:12.450288 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.virt.hardware [None req-6b75886e-85bc-4d5a-84b6-f4700b9a9f10 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Flavor limits 0:0:0 {{(pid=124204) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 10:40:12.450886 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.virt.hardware [None req-6b75886e-85bc-4d5a-84b6-f4700b9a9f10 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Image limits 0:0:0 {{(pid=124204) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 10:40:12.451377 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.virt.hardware [None req-6b75886e-85bc-4d5a-84b6-f4700b9a9f10 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Flavor pref 0:0:0 {{(pid=124204) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 10:40:12.451888 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.virt.hardware [None req-6b75886e-85bc-4d5a-84b6-f4700b9a9f10 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Image pref 0:0:0 {{(pid=124204) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 10:40:12.452407 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.virt.hardware [None req-6b75886e-85bc-4d5a-84b6-f4700b9a9f10 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124204) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 10:40:12.477228 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6b75886e-85bc-4d5a-84b6-f4700b9a9f10 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:12.479351 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6b75886e-85bc-4d5a-84b6-f4700b9a9f10 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:12.480694 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6b75886e-85bc-4d5a-84b6-f4700b9a9f10 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:12.485467 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6b75886e-85bc-4d5a-84b6-f4700b9a9f10 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:12.565678 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.quota [None req-6b75886e-85bc-4d5a-84b6-f4700b9a9f10 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Getting quotas for project 0e38b1cc4c0d45a8b38ba7b670f83c79. Resources: {'instances', 'cores', 'ram'} {{(pid=124204) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 10:40:12.585711 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.quota [None req-6b75886e-85bc-4d5a-84b6-f4700b9a9f10 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Getting quotas for user 6c963986b46d4d148fc843b0a1183d69 and project 0e38b1cc4c0d45a8b38ba7b670f83c79. Resources: {'instances', 'cores', 'ram'} {{(pid=124204) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 10:40:12.632470 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-6b75886e-85bc-4d5a-84b6-f4700b9a9f10 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Going to run 1 instances... {{(pid=124204) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 10:40:12.636990 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-6b75886e-85bc-4d5a-84b6-f4700b9a9f10 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 109c8a70-7b89-45b4-8876-a3286375b27d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c473bd04-5a45-4eb7-b6f4-2b5033d4fc1d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124204) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 10:40:12.835551 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-6b75886e-85bc-4d5a-84b6-f4700b9a9f10 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.292552 Jun 30 10:40:12.843670 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 4/8] 10.222.0.59 () {60 vars in 1146 bytes} [Thu Jun 30 10:40:08 2022] POST /compute/v2.1/servers => generated 383 bytes in 4301 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 10:40:12.855836 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-692e8aca-3985-43ac-b386-cfcdb0affafb tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:12.856620 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-692e8aca-3985-43ac-b386-cfcdb0affafb tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 109c8a70-7b89-45b4-8876-a3286375b27d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:13.025050 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-692e8aca-3985-43ac-b386-cfcdb0affafb tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:13.067560 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-692e8aca-3985-43ac-b386-cfcdb0affafb tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d" status: 200 len: 1220 microversion: 2.1 time: 0.216840 Jun 30 10:40:13.068490 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 5/9] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:12 2022] GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d => generated 1220 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:13.392430 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-a8adceb4-5b76-40d0-8c3c-9c1ed9260174 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-172656732", "imageRef": "c473bd04-5a45-4eb7-b6f4-2b5033d4fc1d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:40:13.533092 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.network.neutron [None req-a8adceb4-5b76-40d0-8c3c-9c1ed9260174 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] validate_networks() for [('8ad12fa2-834f-4c86-9669-8b937fe31721', None, None, None, None, None)] {{(pid=124204) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 10:40:14.294399 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-1c402c98-a22e-4bfc-8ac9-bc2eb24f4cc5 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Action: 'create', calling method: .version_select at 0x7f4dafb86700>, body: {"keypair": {"name": "tempest-keypair-399491739", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK/qVzzddq+KpZwQU2s3bK7sP2XvJW18otB7kHWAHRHsc8hJIJ3rc2ju1k0xNP3F7Bbny/cIwNbuARWWItDB/fR6hbgyyC3C0/d/zGvDYqsdk6BqoYj5baxw4Cq8dVzGbw=="}} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:40:14.409568 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.quota [None req-1c402c98-a22e-4bfc-8ac9-bc2eb24f4cc5 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Getting quotas for project a531892a5f9e4964aa9b35519ad72b68. Resources: {'key_pairs'} {{(pid=124203) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 10:40:14.423371 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.quota [None req-1c402c98-a22e-4bfc-8ac9-bc2eb24f4cc5 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Getting quotas for user 131fb3808ea341618e17256b43862937 and project a531892a5f9e4964aa9b35519ad72b68. Resources: {'key_pairs'} {{(pid=124203) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 10:40:14.573591 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-1c402c98-a22e-4bfc-8ac9-bc2eb24f4cc5 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.646661 Jun 30 10:40:14.574219 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 6/10] 10.222.0.59 () {60 vars in 1158 bytes} [Thu Jun 30 10:40:13 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 10:40:14.742728 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-b0a6cc87-d8b3-4ae6-a540-ee59210d4cbb tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-480263242", "imageRef": "c473bd04-5a45-4eb7-b6f4-2b5033d4fc1d", "flavorRef": "452", "networks": [{"uuid": "7e69957d-535f-4a1a-9e32-90337bb3c143"}]}} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:40:14.967453 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.network.neutron [None req-b0a6cc87-d8b3-4ae6-a540-ee59210d4cbb tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] validate_networks() for [('7e69957d-535f-4a1a-9e32-90337bb3c143', None, None, None, None, None)] {{(pid=124203) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 10:40:16.545359 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.virt.hardware [None req-a8adceb4-5b76-40d0-8c3c-9c1ed9260174 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Flavor limits 0:0:0 {{(pid=124204) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 10:40:16.545902 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.virt.hardware [None req-a8adceb4-5b76-40d0-8c3c-9c1ed9260174 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Image limits 0:0:0 {{(pid=124204) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 10:40:16.546252 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.virt.hardware [None req-a8adceb4-5b76-40d0-8c3c-9c1ed9260174 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Flavor pref 0:0:0 {{(pid=124204) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 10:40:16.546665 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.virt.hardware [None req-a8adceb4-5b76-40d0-8c3c-9c1ed9260174 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Image pref 0:0:0 {{(pid=124204) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 10:40:16.547633 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.virt.hardware [None req-a8adceb4-5b76-40d0-8c3c-9c1ed9260174 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124204) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 10:40:16.591097 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a8adceb4-5b76-40d0-8c3c-9c1ed9260174 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:16.591625 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a8adceb4-5b76-40d0-8c3c-9c1ed9260174 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:16.593010 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a8adceb4-5b76-40d0-8c3c-9c1ed9260174 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:16.598315 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a8adceb4-5b76-40d0-8c3c-9c1ed9260174 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:16.650514 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.quota [None req-a8adceb4-5b76-40d0-8c3c-9c1ed9260174 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Getting quotas for project 0e38b1cc4c0d45a8b38ba7b670f83c79. Resources: {'instances', 'cores', 'ram'} {{(pid=124204) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 10:40:16.656230 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.quota [None req-a8adceb4-5b76-40d0-8c3c-9c1ed9260174 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Getting quotas for user 6c963986b46d4d148fc843b0a1183d69 and project 0e38b1cc4c0d45a8b38ba7b670f83c79. Resources: {'instances', 'cores', 'ram'} {{(pid=124204) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 10:40:16.695971 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-a8adceb4-5b76-40d0-8c3c-9c1ed9260174 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Going to run 1 instances... {{(pid=124204) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 10:40:16.700085 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-a8adceb4-5b76-40d0-8c3c-9c1ed9260174 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c473bd04-5a45-4eb7-b6f4-2b5033d4fc1d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124204) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 10:40:16.759409 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-a8adceb4-5b76-40d0-8c3c-9c1ed9260174 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.372615 Jun 30 10:40:16.760865 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 5/11] 10.222.0.59 () {60 vars in 1146 bytes} [Thu Jun 30 10:40:13 2022] POST /compute/v2.1/servers => generated 383 bytes in 3375 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 10:40:16.897645 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-991f61da-a3ef-49ed-bd7d-aa43af6a791b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Action: 'create', calling method: .version_select at 0x7f4daf33b940>, body: {"keypair": {"name": "tempest-keypair-1225802783", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHN/xr2Ispdjit2fTfQ6pAY3dbXdK5S/uy8ZVglfIMnBssX+trzD6Qujh+DWePLcxPEO1pOVLKt3XNqyhuD7ft4fixe9czj997wJWEIx03Enw9fpXLugxlSEV2ZH4cK1TQ=="}} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:40:16.955267 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.quota [None req-991f61da-a3ef-49ed-bd7d-aa43af6a791b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Getting quotas for project 2346c16770124c9a86bc6e30880f8bde. Resources: {'key_pairs'} {{(pid=124204) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 10:40:16.962165 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.quota [None req-991f61da-a3ef-49ed-bd7d-aa43af6a791b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Getting quotas for user f5003e984d58440a80d98405d187eab0 and project 2346c16770124c9a86bc6e30880f8bde. Resources: {'key_pairs'} {{(pid=124204) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 10:40:17.058429 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-991f61da-a3ef-49ed-bd7d-aa43af6a791b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.295967 Jun 30 10:40:17.060888 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 6/12] 10.222.0.59 () {62 vars in 1199 bytes} [Thu Jun 30 10:40:16 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 299 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 30 10:40:17.080693 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-e8214942-87cb-411f-8733-3d5b5213de51 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:17.080693 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-e8214942-87cb-411f-8733-3d5b5213de51 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:17.338235 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-e8214942-87cb-411f-8733-3d5b5213de51 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:17.387143 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-e8214942-87cb-411f-8733-3d5b5213de51 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1221 microversion: 2.1 time: 0.321361 Jun 30 10:40:17.388692 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 7/13] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:17 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1221 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:17.454370 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.virt.hardware [None req-b0a6cc87-d8b3-4ae6-a540-ee59210d4cbb tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Flavor limits 0:0:0 {{(pid=124203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 10:40:17.454895 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.virt.hardware [None req-b0a6cc87-d8b3-4ae6-a540-ee59210d4cbb tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Image limits 0:0:0 {{(pid=124203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 10:40:17.455273 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.virt.hardware [None req-b0a6cc87-d8b3-4ae6-a540-ee59210d4cbb tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Flavor pref 0:0:0 {{(pid=124203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 10:40:17.455687 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.virt.hardware [None req-b0a6cc87-d8b3-4ae6-a540-ee59210d4cbb tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Image pref 0:0:0 {{(pid=124203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 10:40:17.456131 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.virt.hardware [None req-b0a6cc87-d8b3-4ae6-a540-ee59210d4cbb tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 10:40:17.481449 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b0a6cc87-d8b3-4ae6-a540-ee59210d4cbb tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:17.485410 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b0a6cc87-d8b3-4ae6-a540-ee59210d4cbb tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:17.488117 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b0a6cc87-d8b3-4ae6-a540-ee59210d4cbb tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:17.490968 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b0a6cc87-d8b3-4ae6-a540-ee59210d4cbb tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:17.598567 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.quota [None req-b0a6cc87-d8b3-4ae6-a540-ee59210d4cbb tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Getting quotas for project ff16d27fbbe7475782fe2202e34aec7f. Resources: {'instances', 'cores', 'ram'} {{(pid=124203) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 10:40:17.612953 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.quota [None req-b0a6cc87-d8b3-4ae6-a540-ee59210d4cbb tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Getting quotas for user 9ad75a8b887a4a40accb49603f03c8ee and project ff16d27fbbe7475782fe2202e34aec7f. Resources: {'instances', 'cores', 'ram'} {{(pid=124203) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 10:40:17.682232 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-b0a6cc87-d8b3-4ae6-a540-ee59210d4cbb tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Going to run 1 instances... {{(pid=124203) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 10:40:17.685077 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-b0a6cc87-d8b3-4ae6-a540-ee59210d4cbb tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] [instance: 5c8d5bc5-4671-4189-94e0-1442e872fc2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c473bd04-5a45-4eb7-b6f4-2b5033d4fc1d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124203) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 10:40:17.953985 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-b0a6cc87-d8b3-4ae6-a540-ee59210d4cbb tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.371286 Jun 30 10:40:17.955120 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 7/14] 10.222.0.59 () {60 vars in 1146 bytes} [Thu Jun 30 10:40:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 3374 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 10:40:17.974608 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-1ab80314-a5d0-41d2-8c5a-1504e05c6ecc tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:17.975597 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-1ab80314-a5d0-41d2-8c5a-1504e05c6ecc tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] [instance: 5c8d5bc5-4671-4189-94e0-1442e872fc2d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:18.394468 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-1ab80314-a5d0-41d2-8c5a-1504e05c6ecc tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad75a8b887a4a40accb49603f03c8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d27fbbe7475782fe2202e34aec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:18.405813 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-e10f390a-9f5d-4704-96c2-b70d0160ddc5 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:18.406487 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-e10f390a-9f5d-4704-96c2-b70d0160ddc5 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:18.411821 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-1ab80314-a5d0-41d2-8c5a-1504e05c6ecc tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] 10.222.0.59 "GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d" status: 200 len: 1214 microversion: 2.1 time: 0.449028 Jun 30 10:40:18.426597 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 8/15] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:17 2022] GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d => generated 1214 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:18.587743 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-e10f390a-9f5d-4704-96c2-b70d0160ddc5 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:18.613405 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-e10f390a-9f5d-4704-96c2-b70d0160ddc5 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1221 microversion: 2.1 time: 0.196974 Jun 30 10:40:18.613405 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 8/16] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:18 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1221 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:40:19.429926 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-174dc792-3b00-46db-ba70-b9a0ab59b8e6 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:19.430779 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-174dc792-3b00-46db-ba70-b9a0ab59b8e6 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] [instance: 5c8d5bc5-4671-4189-94e0-1442e872fc2d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:19.441918 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-174dc792-3b00-46db-ba70-b9a0ab59b8e6 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:19.445771 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-174dc792-3b00-46db-ba70-b9a0ab59b8e6 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:19.446762 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-174dc792-3b00-46db-ba70-b9a0ab59b8e6 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:19.448832 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-174dc792-3b00-46db-ba70-b9a0ab59b8e6 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:19.507649 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-998b2617-64c1-474b-a002-e7f403566907 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Action: 'create', calling method: .version_select at 0x7f4daeaec5e0>, body: {"keypair": {"name": "tempest-keypair-379202773", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPRhKfhw4i08yAdoZuTbiW7jCj+E2RlLUk2J5/fgE2CaFJmnLuov6mkhqUfRdI0u12lJgh+PsjlJszj3YrTsBZLxn/vR2OXoPofgo1mHHouXZRMzVDYUNVe2LUG3VTVLFg=="}} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:40:19.587362 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.quota [None req-998b2617-64c1-474b-a002-e7f403566907 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Getting quotas for project 848d69e5041341488aafc3e6d26d491c. Resources: {'key_pairs'} {{(pid=124204) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 10:40:19.599189 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.quota [None req-998b2617-64c1-474b-a002-e7f403566907 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Getting quotas for user d6a194d68415422fbc6ca75a8dbccf22 and project 848d69e5041341488aafc3e6d26d491c. Resources: {'key_pairs'} {{(pid=124204) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 10:40:19.704582 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-998b2617-64c1-474b-a002-e7f403566907 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.685972 Jun 30 10:40:19.705943 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 9/17] 10.222.0.59 () {60 vars in 1158 bytes} [Thu Jun 30 10:40:19 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:40:19.720123 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-c8e9d4af-7423-4e61-954b-24daf03ce5b2 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:19.721096 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-c8e9d4af-7423-4e61-954b-24daf03ce5b2 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:19.743355 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c8e9d4af-7423-4e61-954b-24daf03ce5b2 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:19.744031 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c8e9d4af-7423-4e61-954b-24daf03ce5b2 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:19.745263 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c8e9d4af-7423-4e61-954b-24daf03ce5b2 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:19.746440 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c8e9d4af-7423-4e61-954b-24daf03ce5b2 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:19.871621 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-174dc792-3b00-46db-ba70-b9a0ab59b8e6 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad75a8b887a4a40accb49603f03c8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d27fbbe7475782fe2202e34aec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:19.933723 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-174dc792-3b00-46db-ba70-b9a0ab59b8e6 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] 10.222.0.59 "GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d" status: 200 len: 1266 microversion: 2.1 time: 0.506315 Jun 30 10:40:19.950880 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 9/18] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:19 2022] GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d => generated 1266 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:20.312195 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-c8e9d4af-7423-4e61-954b-24daf03ce5b2 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:20.339646 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-c8e9d4af-7423-4e61-954b-24daf03ce5b2 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1273 microversion: 2.1 time: 0.631799 Jun 30 10:40:20.362368 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 10/19] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:19 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1273 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:20.951238 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-e378ed51-48ab-41eb-872e-7a8f18ad9cc5 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:20.952645 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-e378ed51-48ab-41eb-872e-7a8f18ad9cc5 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] [instance: 5c8d5bc5-4671-4189-94e0-1442e872fc2d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:20.964647 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e378ed51-48ab-41eb-872e-7a8f18ad9cc5 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:20.965308 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e378ed51-48ab-41eb-872e-7a8f18ad9cc5 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:20.973783 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e378ed51-48ab-41eb-872e-7a8f18ad9cc5 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:20.974460 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e378ed51-48ab-41eb-872e-7a8f18ad9cc5 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:21.286225 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-e378ed51-48ab-41eb-872e-7a8f18ad9cc5 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad75a8b887a4a40accb49603f03c8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d27fbbe7475782fe2202e34aec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:21.302621 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-e378ed51-48ab-41eb-872e-7a8f18ad9cc5 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] 10.222.0.59 "GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d" status: 200 len: 1266 microversion: 2.1 time: 0.355020 Jun 30 10:40:21.317079 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 10/20] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:20 2022] GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d => generated 1266 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:21.380819 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-263397b5-ea56-44cd-9f73-790ed278e3f3 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:21.382945 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-263397b5-ea56-44cd-9f73-790ed278e3f3 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:21.409966 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-263397b5-ea56-44cd-9f73-790ed278e3f3 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:21.413184 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-263397b5-ea56-44cd-9f73-790ed278e3f3 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:21.414319 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-263397b5-ea56-44cd-9f73-790ed278e3f3 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:21.416566 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-263397b5-ea56-44cd-9f73-790ed278e3f3 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:21.679011 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-263397b5-ea56-44cd-9f73-790ed278e3f3 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:21.690744 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-263397b5-ea56-44cd-9f73-790ed278e3f3 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1273 microversion: 2.1 time: 0.320282 Jun 30 10:40:21.704573 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 11/21] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:21 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1273 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:21.880636 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-3049ebe3-7ef9-425f-8603-ba0893f98af2 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1790125603", "imageRef": "c473bd04-5a45-4eb7-b6f4-2b5033d4fc1d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "495998d3-6741-43d1-b79b-1335d3468e40"}], "security_groups": [{"name": "tempest-securitygroup--1680645248"}], "key_name": "tempest-keypair-399491739", "user_data": "}} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:40:22.330050 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-b8dfaea9-9912-4903-8406-34105d3042db tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:22.330050 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-b8dfaea9-9912-4903-8406-34105d3042db tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] [instance: 5c8d5bc5-4671-4189-94e0-1442e872fc2d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:22.336491 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-b8dfaea9-9912-4903-8406-34105d3042db tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:22.342472 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-b8dfaea9-9912-4903-8406-34105d3042db tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:22.344333 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-b8dfaea9-9912-4903-8406-34105d3042db tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:22.350224 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-b8dfaea9-9912-4903-8406-34105d3042db tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:22.404655 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.network.neutron [None req-3049ebe3-7ef9-425f-8603-ba0893f98af2 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] validate_networks() for [('495998d3-6741-43d1-b79b-1335d3468e40', None, None, None, None, None)] {{(pid=124203) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 10:40:22.748534 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-b8dfaea9-9912-4903-8406-34105d3042db tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad75a8b887a4a40accb49603f03c8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d27fbbe7475782fe2202e34aec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:22.788222 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-b8dfaea9-9912-4903-8406-34105d3042db tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] 10.222.0.59 "GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d" status: 200 len: 1266 microversion: 2.1 time: 0.463288 Jun 30 10:40:22.793965 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 12/22] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:22 2022] GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d => generated 1266 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:40:22.809708 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-12bd2f40-feb5-4432-81bb-4213110765ee tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:22.810742 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-12bd2f40-feb5-4432-81bb-4213110765ee tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:22.834113 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-12bd2f40-feb5-4432-81bb-4213110765ee tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:22.834979 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-12bd2f40-feb5-4432-81bb-4213110765ee tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:22.836825 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-12bd2f40-feb5-4432-81bb-4213110765ee tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:22.837483 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-12bd2f40-feb5-4432-81bb-4213110765ee tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:23.104478 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-12bd2f40-feb5-4432-81bb-4213110765ee tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:23.114997 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-12bd2f40-feb5-4432-81bb-4213110765ee tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1273 microversion: 2.1 time: 0.319116 Jun 30 10:40:23.115592 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 13/23] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:22 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1273 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:23.468730 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-d46e613c-59d7-4a10-8914-371eeb0690a3 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1488076338", "imageRef": "c473bd04-5a45-4eb7-b6f4-2b5033d4fc1d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7e9d61a2-83fe-4a84-abef-49f52aac027b"}], "security_groups": [{"name": "tempest-securitygroup--724418272"}], "key_name": "tempest-keypair-1225802783", "user_data": "}} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:40:24.104397 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.network.neutron [None req-d46e613c-59d7-4a10-8914-371eeb0690a3 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] validate_networks() for [('7e9d61a2-83fe-4a84-abef-49f52aac027b', None, None, None, None, None)] {{(pid=124204) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 10:40:24.402203 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.virt.hardware [None req-3049ebe3-7ef9-425f-8603-ba0893f98af2 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Flavor limits 0:0:0 {{(pid=124203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 10:40:24.402717 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.virt.hardware [None req-3049ebe3-7ef9-425f-8603-ba0893f98af2 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Image limits 0:0:0 {{(pid=124203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 10:40:24.403099 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.virt.hardware [None req-3049ebe3-7ef9-425f-8603-ba0893f98af2 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Flavor pref 0:0:0 {{(pid=124203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 10:40:24.403514 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.virt.hardware [None req-3049ebe3-7ef9-425f-8603-ba0893f98af2 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Image pref 0:0:0 {{(pid=124203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 10:40:24.403927 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.virt.hardware [None req-3049ebe3-7ef9-425f-8603-ba0893f98af2 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 10:40:24.422499 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-3049ebe3-7ef9-425f-8603-ba0893f98af2 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:24.424972 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-3049ebe3-7ef9-425f-8603-ba0893f98af2 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:24.425978 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-3049ebe3-7ef9-425f-8603-ba0893f98af2 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:24.427620 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-3049ebe3-7ef9-425f-8603-ba0893f98af2 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:24.474202 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.quota [None req-3049ebe3-7ef9-425f-8603-ba0893f98af2 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Getting quotas for project a531892a5f9e4964aa9b35519ad72b68. Resources: {'instances', 'cores', 'ram'} {{(pid=124203) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 10:40:24.486003 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.quota [None req-3049ebe3-7ef9-425f-8603-ba0893f98af2 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Getting quotas for user 131fb3808ea341618e17256b43862937 and project a531892a5f9e4964aa9b35519ad72b68. Resources: {'instances', 'cores', 'ram'} {{(pid=124203) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 10:40:24.511729 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-3049ebe3-7ef9-425f-8603-ba0893f98af2 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Going to run 1 instances... {{(pid=124203) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 10:40:24.519896 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-3049ebe3-7ef9-425f-8603-ba0893f98af2 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c473bd04-5a45-4eb7-b6f4-2b5033d4fc1d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124203) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 10:40:24.654256 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-3049ebe3-7ef9-425f-8603-ba0893f98af2 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.780782 Jun 30 10:40:24.658094 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 11/24] 10.222.0.59 () {60 vars in 1146 bytes} [Thu Jun 30 10:40:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 2786 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 10:40:24.680862 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-885eb11b-4bb9-4813-967f-99b45adffd23 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:24.681916 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-885eb11b-4bb9-4813-967f-99b45adffd23 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] [instance: 5c8d5bc5-4671-4189-94e0-1442e872fc2d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:24.737646 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-885eb11b-4bb9-4813-967f-99b45adffd23 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:24.738095 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-885eb11b-4bb9-4813-967f-99b45adffd23 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:24.738873 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-885eb11b-4bb9-4813-967f-99b45adffd23 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:24.739311 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-885eb11b-4bb9-4813-967f-99b45adffd23 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:24.987246 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-885eb11b-4bb9-4813-967f-99b45adffd23 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad75a8b887a4a40accb49603f03c8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d27fbbe7475782fe2202e34aec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:24.997603 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-885eb11b-4bb9-4813-967f-99b45adffd23 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] 10.222.0.59 "GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d" status: 200 len: 1266 microversion: 2.1 time: 0.336287 Jun 30 10:40:24.998212 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 12/25] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:24 2022] GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d => generated 1266 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:25.040194 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-4cf1f281-7751-4a07-91b8-aaf0352474cc tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-834067901", "imageRef": "c473bd04-5a45-4eb7-b6f4-2b5033d4fc1d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e1b0416a-2d8f-4305-a932-70d38f831d37"}], "security_groups": [{"name": "tempest-securitygroup--1782948285"}], "key_name": "tempest-keypair-379202773", "user_data": "}} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:40:25.327861 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.virt.hardware [None req-d46e613c-59d7-4a10-8914-371eeb0690a3 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Flavor limits 0:0:0 {{(pid=124204) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 10:40:25.328559 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.virt.hardware [None req-d46e613c-59d7-4a10-8914-371eeb0690a3 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Image limits 0:0:0 {{(pid=124204) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 10:40:25.329101 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.virt.hardware [None req-d46e613c-59d7-4a10-8914-371eeb0690a3 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Flavor pref 0:0:0 {{(pid=124204) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 10:40:25.329585 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.virt.hardware [None req-d46e613c-59d7-4a10-8914-371eeb0690a3 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Image pref 0:0:0 {{(pid=124204) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 10:40:25.330122 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.virt.hardware [None req-d46e613c-59d7-4a10-8914-371eeb0690a3 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124204) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 10:40:25.352007 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d46e613c-59d7-4a10-8914-371eeb0690a3 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:25.356338 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d46e613c-59d7-4a10-8914-371eeb0690a3 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:25.361091 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d46e613c-59d7-4a10-8914-371eeb0690a3 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:25.362091 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d46e613c-59d7-4a10-8914-371eeb0690a3 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:25.418973 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.quota [None req-d46e613c-59d7-4a10-8914-371eeb0690a3 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Getting quotas for project 2346c16770124c9a86bc6e30880f8bde. Resources: {'instances', 'cores', 'ram'} {{(pid=124204) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 10:40:25.444136 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.network.neutron [None req-4cf1f281-7751-4a07-91b8-aaf0352474cc tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] validate_networks() for [('e1b0416a-2d8f-4305-a932-70d38f831d37', None, None, None, None, None)] {{(pid=124203) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 10:40:25.445271 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.quota [None req-d46e613c-59d7-4a10-8914-371eeb0690a3 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Getting quotas for user f5003e984d58440a80d98405d187eab0 and project 2346c16770124c9a86bc6e30880f8bde. Resources: {'instances', 'cores', 'ram'} {{(pid=124204) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 10:40:25.483832 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-d46e613c-59d7-4a10-8914-371eeb0690a3 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Going to run 1 instances... {{(pid=124204) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 10:40:25.487306 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-d46e613c-59d7-4a10-8914-371eeb0690a3 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c473bd04-5a45-4eb7-b6f4-2b5033d4fc1d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124204) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 10:40:25.591704 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-d46e613c-59d7-4a10-8914-371eeb0690a3 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.127345 Jun 30 10:40:25.598940 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 14/26] 10.222.0.59 () {62 vars in 1187 bytes} [Thu Jun 30 10:40:23 2022] POST /compute/v2.1/servers => generated 401 bytes in 2135 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jun 30 10:40:25.603728 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-66a2c8b8-19e0-4af6-a9ae-a36b402c7921 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:25.604821 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-66a2c8b8-19e0-4af6-a9ae-a36b402c7921 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:25.615976 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-66a2c8b8-19e0-4af6-a9ae-a36b402c7921 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:25.616791 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-66a2c8b8-19e0-4af6-a9ae-a36b402c7921 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:25.617787 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-66a2c8b8-19e0-4af6-a9ae-a36b402c7921 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:25.618450 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-66a2c8b8-19e0-4af6-a9ae-a36b402c7921 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:26.017623 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-66a2c8b8-19e0-4af6-a9ae-a36b402c7921 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:26.033126 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-66a2c8b8-19e0-4af6-a9ae-a36b402c7921 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1279 microversion: 2.1 time: 0.429042 Jun 30 10:40:26.033768 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 15/27] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:25 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1279 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:26.048769 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-38c3f39e-55ff-406a-962a-f49ef4acafa6 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:26.049776 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-38c3f39e-55ff-406a-962a-f49ef4acafa6 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:26.067280 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-38c3f39e-55ff-406a-962a-f49ef4acafa6 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:26.069005 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-38c3f39e-55ff-406a-962a-f49ef4acafa6 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:26.070055 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-38c3f39e-55ff-406a-962a-f49ef4acafa6 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:26.073068 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-38c3f39e-55ff-406a-962a-f49ef4acafa6 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:26.543955 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-38c3f39e-55ff-406a-962a-f49ef4acafa6 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:26.558180 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-38c3f39e-55ff-406a-962a-f49ef4acafa6 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1241 microversion: 2.1 time: 0.522542 Jun 30 10:40:26.560872 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 16/28] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:26 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1241 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:26.578185 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-2dfdccef-cb7c-48f0-9e29-2146051d50fe tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:26.578819 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-2dfdccef-cb7c-48f0-9e29-2146051d50fe tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:26.613037 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.virt.hardware [None req-4cf1f281-7751-4a07-91b8-aaf0352474cc tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Flavor limits 0:0:0 {{(pid=124203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 10:40:26.613532 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.virt.hardware [None req-4cf1f281-7751-4a07-91b8-aaf0352474cc tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Image limits 0:0:0 {{(pid=124203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 10:40:26.614628 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.virt.hardware [None req-4cf1f281-7751-4a07-91b8-aaf0352474cc tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Flavor pref 0:0:0 {{(pid=124203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 10:40:26.615711 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.virt.hardware [None req-4cf1f281-7751-4a07-91b8-aaf0352474cc tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Image pref 0:0:0 {{(pid=124203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 10:40:26.616729 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.virt.hardware [None req-4cf1f281-7751-4a07-91b8-aaf0352474cc tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 10:40:26.658665 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-4cf1f281-7751-4a07-91b8-aaf0352474cc tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:26.659091 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-4cf1f281-7751-4a07-91b8-aaf0352474cc tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:26.669452 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-4cf1f281-7751-4a07-91b8-aaf0352474cc tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:26.670828 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-4cf1f281-7751-4a07-91b8-aaf0352474cc tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:26.789784 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.quota [None req-4cf1f281-7751-4a07-91b8-aaf0352474cc tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Getting quotas for project 848d69e5041341488aafc3e6d26d491c. Resources: {'instances', 'cores', 'ram'} {{(pid=124203) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 10:40:26.838332 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.quota [None req-4cf1f281-7751-4a07-91b8-aaf0352474cc tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Getting quotas for user d6a194d68415422fbc6ca75a8dbccf22 and project 848d69e5041341488aafc3e6d26d491c. Resources: {'instances', 'cores', 'ram'} {{(pid=124203) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 10:40:26.863013 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-2dfdccef-cb7c-48f0-9e29-2146051d50fe tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:26.873856 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-2dfdccef-cb7c-48f0-9e29-2146051d50fe tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:26.890084 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-2dfdccef-cb7c-48f0-9e29-2146051d50fe tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:26.898015 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-2dfdccef-cb7c-48f0-9e29-2146051d50fe tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1282 microversion: 2.20 time: 0.336022 Jun 30 10:40:26.903498 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 17/29] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:40:26 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1282 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:40:26.922180 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-3e1165a4-a878-45eb-9f7a-bfb35150bb23 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:26.924743 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-4cf1f281-7751-4a07-91b8-aaf0352474cc tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Going to run 1 instances... {{(pid=124203) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 10:40:26.928968 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-3e1165a4-a878-45eb-9f7a-bfb35150bb23 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] [instance: 5c8d5bc5-4671-4189-94e0-1442e872fc2d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:26.935577 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:26.939397 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-4cf1f281-7751-4a07-91b8-aaf0352474cc tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 6bc2024c-c05e-4409-a142-e8cf3191a203] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c473bd04-5a45-4eb7-b6f4-2b5033d4fc1d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124203) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 10:40:26.944860 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-3e1165a4-a878-45eb-9f7a-bfb35150bb23 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:26.946148 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-3e1165a4-a878-45eb-9f7a-bfb35150bb23 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:26.948227 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-3e1165a4-a878-45eb-9f7a-bfb35150bb23 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:26.950289 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-3e1165a4-a878-45eb-9f7a-bfb35150bb23 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:27.089872 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-3e1165a4-a878-45eb-9f7a-bfb35150bb23 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad75a8b887a4a40accb49603f03c8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d27fbbe7475782fe2202e34aec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:27.099823 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-3e1165a4-a878-45eb-9f7a-bfb35150bb23 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] 10.222.0.59 "GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d" status: 200 len: 1274 microversion: 2.1 time: 0.194847 Jun 30 10:40:27.101204 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 18/30] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:26 2022] GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d => generated 1274 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:27.113317 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-e6b4bc8c-b147-4a6c-a99c-9443893d5ccc tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:27.113317 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-e6b4bc8c-b147-4a6c-a99c-9443893d5ccc tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:27.128330 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-e6b4bc8c-b147-4a6c-a99c-9443893d5ccc tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:27.129405 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-e6b4bc8c-b147-4a6c-a99c-9443893d5ccc tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:27.132631 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-e6b4bc8c-b147-4a6c-a99c-9443893d5ccc tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:27.133394 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-e6b4bc8c-b147-4a6c-a99c-9443893d5ccc tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:27.138420 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-4cf1f281-7751-4a07-91b8-aaf0352474cc tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.139130 Jun 30 10:40:27.139081 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 13/31] 10.222.0.59 () {60 vars in 1146 bytes} [Thu Jun 30 10:40:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 2140 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 10:40:27.150233 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-43014760-48a1-4160-93f4-c5fbaf21427f tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:27.150840 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-43014760-48a1-4160-93f4-c5fbaf21427f tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 6bc2024c-c05e-4409-a142-e8cf3191a203] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:27.412234 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-43014760-48a1-4160-93f4-c5fbaf21427f tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:27.421158 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-43014760-48a1-4160-93f4-c5fbaf21427f tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203" status: 200 len: 1240 microversion: 2.1 time: 0.274732 Jun 30 10:40:27.424715 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 14/32] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:27 2022] GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203 => generated 1240 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:27.538517 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-e6b4bc8c-b147-4a6c-a99c-9443893d5ccc tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:27.550401 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-e6b4bc8c-b147-4a6c-a99c-9443893d5ccc tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1321 microversion: 2.1 time: 0.447173 Jun 30 10:40:27.553322 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 19/33] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:27 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1321 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:27.588064 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-000479a5-3988-42de-ab12-1c284876d676 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:27.590444 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-000479a5-3988-42de-ab12-1c284876d676 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:27.598960 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-000479a5-3988-42de-ab12-1c284876d676 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:27.610575 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-000479a5-3988-42de-ab12-1c284876d676 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:27.611792 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-000479a5-3988-42de-ab12-1c284876d676 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:27.612592 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-000479a5-3988-42de-ab12-1c284876d676 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:27.744339 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-000479a5-3988-42de-ab12-1c284876d676 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:27.763109 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-000479a5-3988-42de-ab12-1c284876d676 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1241 microversion: 2.1 time: 0.183782 Jun 30 10:40:27.769220 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 15/34] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:27 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1241 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:27.922897 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-f792f2af-330c-41e2-8ddd-e7adb25f225b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:27.923681 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-f792f2af-330c-41e2-8ddd-e7adb25f225b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:27.940357 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f792f2af-330c-41e2-8ddd-e7adb25f225b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:27.940970 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f792f2af-330c-41e2-8ddd-e7adb25f225b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:27.944579 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f792f2af-330c-41e2-8ddd-e7adb25f225b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:27.945172 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f792f2af-330c-41e2-8ddd-e7adb25f225b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:28.097305 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-f792f2af-330c-41e2-8ddd-e7adb25f225b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:28.122469 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-304faf32-5f68-4eae-9b18-2129972d9e75 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:28.123521 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-304faf32-5f68-4eae-9b18-2129972d9e75 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] [instance: 5c8d5bc5-4671-4189-94e0-1442e872fc2d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:28.135823 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-304faf32-5f68-4eae-9b18-2129972d9e75 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:28.138131 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-304faf32-5f68-4eae-9b18-2129972d9e75 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:28.142850 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-304faf32-5f68-4eae-9b18-2129972d9e75 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:28.145474 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-f792f2af-330c-41e2-8ddd-e7adb25f225b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:28.145612 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-304faf32-5f68-4eae-9b18-2129972d9e75 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:28.164182 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-f792f2af-330c-41e2-8ddd-e7adb25f225b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:28.165440 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-f792f2af-330c-41e2-8ddd-e7adb25f225b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1286 microversion: 2.20 time: 0.248335 Jun 30 10:40:28.166039 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 20/35] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:40:27 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1286 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:40:28.285953 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-304faf32-5f68-4eae-9b18-2129972d9e75 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad75a8b887a4a40accb49603f03c8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d27fbbe7475782fe2202e34aec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:28.312813 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-304faf32-5f68-4eae-9b18-2129972d9e75 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] 10.222.0.59 "GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d" status: 200 len: 1274 microversion: 2.1 time: 0.197219 Jun 30 10:40:28.313422 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 16/36] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:28 2022] GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d => generated 1274 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:28.442614 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-232dea68-33e5-4101-a77b-5df5d0f95529 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:28.443369 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-232dea68-33e5-4101-a77b-5df5d0f95529 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 6bc2024c-c05e-4409-a142-e8cf3191a203] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:28.463639 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-232dea68-33e5-4101-a77b-5df5d0f95529 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:28.464068 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-232dea68-33e5-4101-a77b-5df5d0f95529 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:28.470150 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-232dea68-33e5-4101-a77b-5df5d0f95529 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:28.470730 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-232dea68-33e5-4101-a77b-5df5d0f95529 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:28.580384 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-b71f5493-350a-41f6-b996-9c5353079c09 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:28.581055 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-b71f5493-350a-41f6-b996-9c5353079c09 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:28.613721 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b71f5493-350a-41f6-b996-9c5353079c09 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:28.614194 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b71f5493-350a-41f6-b996-9c5353079c09 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:28.616208 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b71f5493-350a-41f6-b996-9c5353079c09 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:28.618051 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b71f5493-350a-41f6-b996-9c5353079c09 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:28.721940 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-232dea68-33e5-4101-a77b-5df5d0f95529 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:28.731742 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-232dea68-33e5-4101-a77b-5df5d0f95529 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203" status: 200 len: 1244 microversion: 2.1 time: 0.293928 Jun 30 10:40:28.732534 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 21/37] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:28 2022] GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203 => generated 1244 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:40:28.786289 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-4563408a-64ef-411f-a8d9-4a3a65b16ffd tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:28.786917 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-4563408a-64ef-411f-a8d9-4a3a65b16ffd tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:28.798276 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-4563408a-64ef-411f-a8d9-4a3a65b16ffd tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:28.798732 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-4563408a-64ef-411f-a8d9-4a3a65b16ffd tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:28.799515 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-4563408a-64ef-411f-a8d9-4a3a65b16ffd tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:28.799956 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-4563408a-64ef-411f-a8d9-4a3a65b16ffd tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:28.986747 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-4563408a-64ef-411f-a8d9-4a3a65b16ffd tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:28.998663 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-4563408a-64ef-411f-a8d9-4a3a65b16ffd tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1241 microversion: 2.1 time: 0.216343 Jun 30 10:40:29.013035 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 22/38] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:28 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1241 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:29.030332 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-b71f5493-350a-41f6-b996-9c5353079c09 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:29.039748 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-b71f5493-350a-41f6-b996-9c5353079c09 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1321 microversion: 2.1 time: 0.474136 Jun 30 10:40:29.041071 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 17/39] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:28 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1321 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:40:29.183743 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-38b2c6e8-2648-43fc-a8bb-354a128b82c3 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:29.184358 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-38b2c6e8-2648-43fc-a8bb-354a128b82c3 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:29.201757 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-38b2c6e8-2648-43fc-a8bb-354a128b82c3 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:29.202278 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-38b2c6e8-2648-43fc-a8bb-354a128b82c3 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:29.205251 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-38b2c6e8-2648-43fc-a8bb-354a128b82c3 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:29.205761 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-38b2c6e8-2648-43fc-a8bb-354a128b82c3 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:29.320098 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-38b2c6e8-2648-43fc-a8bb-354a128b82c3 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:29.330518 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-cb9e9b94-f90d-4285-a10a-db1e6cd3b5b2 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:29.331311 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-cb9e9b94-f90d-4285-a10a-db1e6cd3b5b2 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] [instance: 5c8d5bc5-4671-4189-94e0-1442e872fc2d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:29.334921 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-38b2c6e8-2648-43fc-a8bb-354a128b82c3 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:29.337420 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-38b2c6e8-2648-43fc-a8bb-354a128b82c3 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:29.339197 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-38b2c6e8-2648-43fc-a8bb-354a128b82c3 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1286 microversion: 2.20 time: 0.159424 Jun 30 10:40:29.341306 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 23/40] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:40:29 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1286 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:40:29.346558 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-cb9e9b94-f90d-4285-a10a-db1e6cd3b5b2 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:29.350078 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-cb9e9b94-f90d-4285-a10a-db1e6cd3b5b2 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:29.350864 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-cb9e9b94-f90d-4285-a10a-db1e6cd3b5b2 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:29.351354 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-cb9e9b94-f90d-4285-a10a-db1e6cd3b5b2 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:29.447443 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-cb9e9b94-f90d-4285-a10a-db1e6cd3b5b2 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad75a8b887a4a40accb49603f03c8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d27fbbe7475782fe2202e34aec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:29.457789 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-cb9e9b94-f90d-4285-a10a-db1e6cd3b5b2 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] 10.222.0.59 "GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d" status: 200 len: 1274 microversion: 2.1 time: 0.131696 Jun 30 10:40:29.468644 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 18/41] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:29 2022] GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d => generated 1274 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:40:29.535255 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [req-7823ed98-b5dd-4c36-b6ab-3e4fc003f285 req-5cb27c87-1278-4f4e-9ae4-3c93561007a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "109c8a70-7b89-45b4-8876-a3286375b27d", "tag": "f447476f-b643-426d-ab27-775f942eaf6e"}]} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:40:29.546045 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-7823ed98-b5dd-4c36-b6ab-3e4fc003f285 req-5cb27c87-1278-4f4e-9ae4-3c93561007a8 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:29.546996 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-7823ed98-b5dd-4c36-b6ab-3e4fc003f285 req-5cb27c87-1278-4f4e-9ae4-3c93561007a8 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:29.565974 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.compute.server_external_events [req-7823ed98-b5dd-4c36-b6ab-3e4fc003f285 req-5cb27c87-1278-4f4e-9ae4-3c93561007a8 service nova] Creating event network-changed:f447476f-b643-426d-ab27-775f942eaf6e for instance 109c8a70-7b89-45b4-8876-a3286375b27d on hv-cinder-82282 Jun 30 10:40:29.566500 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-7823ed98-b5dd-4c36-b6ab-3e4fc003f285 req-5cb27c87-1278-4f4e-9ae4-3c93561007a8 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124204) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 30 10:40:29.567676 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-aafdbcac-4faf-48b0-9cc1-9390ef346e01 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:29.568121 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-aafdbcac-4faf-48b0-9cc1-9390ef346e01 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:29.568931 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-aafdbcac-4faf-48b0-9cc1-9390ef346e01 None None] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:29.569467 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-aafdbcac-4faf-48b0-9cc1-9390ef346e01 None None] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:29.578935 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.compute.rpcapi [None req-aafdbcac-4faf-48b0-9cc1-9390ef346e01 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 30 10:40:29.579814 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-aafdbcac-4faf-48b0-9cc1-9390ef346e01 None None] Releasing lock "compute-rpcapi-router" {{(pid=124204) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 30 10:40:29.598060 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-aafdbcac-4faf-48b0-9cc1-9390ef346e01 None None] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128543 Jun 30 10:40:29.598709 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 24/42] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:40:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:40:29.748523 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-23a75784-fb8f-4864-9c66-dbd9f46c5716 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:29.749137 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-23a75784-fb8f-4864-9c66-dbd9f46c5716 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 6bc2024c-c05e-4409-a142-e8cf3191a203] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:29.755076 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-23a75784-fb8f-4864-9c66-dbd9f46c5716 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:29.755770 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-23a75784-fb8f-4864-9c66-dbd9f46c5716 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:29.756572 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-23a75784-fb8f-4864-9c66-dbd9f46c5716 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:29.757013 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-23a75784-fb8f-4864-9c66-dbd9f46c5716 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:29.819078 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-23a75784-fb8f-4864-9c66-dbd9f46c5716 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:29.828018 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-23a75784-fb8f-4864-9c66-dbd9f46c5716 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203" status: 200 len: 1244 microversion: 2.1 time: 0.083142 Jun 30 10:40:29.828487 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 19/43] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:29 2022] GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203 => generated 1244 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:30.022199 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-15c4a58f-b722-44a6-91d2-2a4e9d0bead3 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:30.022918 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-15c4a58f-b722-44a6-91d2-2a4e9d0bead3 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:30.029970 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-15c4a58f-b722-44a6-91d2-2a4e9d0bead3 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:30.030422 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-15c4a58f-b722-44a6-91d2-2a4e9d0bead3 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:30.031753 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-15c4a58f-b722-44a6-91d2-2a4e9d0bead3 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:30.032647 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-15c4a58f-b722-44a6-91d2-2a4e9d0bead3 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:30.058718 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-c588066c-a655-4f05-baff-f6f74a32a7f5 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:30.060197 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-c588066c-a655-4f05-baff-f6f74a32a7f5 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:30.067775 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c588066c-a655-4f05-baff-f6f74a32a7f5 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:30.068330 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c588066c-a655-4f05-baff-f6f74a32a7f5 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:30.069339 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c588066c-a655-4f05-baff-f6f74a32a7f5 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:30.069876 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c588066c-a655-4f05-baff-f6f74a32a7f5 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:30.106831 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-15c4a58f-b722-44a6-91d2-2a4e9d0bead3 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:30.117436 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-15c4a58f-b722-44a6-91d2-2a4e9d0bead3 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1241 microversion: 2.1 time: 0.102774 Jun 30 10:40:30.127351 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 25/44] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:30 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1241 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:30.213231 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-c588066c-a655-4f05-baff-f6f74a32a7f5 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:30.221854 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-c588066c-a655-4f05-baff-f6f74a32a7f5 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1321 microversion: 2.1 time: 0.168634 Jun 30 10:40:30.231510 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 20/45] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:30 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1321 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:30.357794 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-fff668e8-6b71-49c4-9517-4ce3616c19c0 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:30.358328 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-fff668e8-6b71-49c4-9517-4ce3616c19c0 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:30.364378 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-fff668e8-6b71-49c4-9517-4ce3616c19c0 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:30.364885 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-fff668e8-6b71-49c4-9517-4ce3616c19c0 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:30.365647 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-fff668e8-6b71-49c4-9517-4ce3616c19c0 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:30.366087 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-fff668e8-6b71-49c4-9517-4ce3616c19c0 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:30.430630 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-fff668e8-6b71-49c4-9517-4ce3616c19c0 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:30.449579 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-fff668e8-6b71-49c4-9517-4ce3616c19c0 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:30.455011 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-fff668e8-6b71-49c4-9517-4ce3616c19c0 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:30.456418 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-fff668e8-6b71-49c4-9517-4ce3616c19c0 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1286 microversion: 2.20 time: 0.102610 Jun 30 10:40:30.457009 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 26/46] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:40:30 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1286 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:40:30.475881 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-1be6e244-1b68-4de0-846f-dbc30e0942fe tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:30.476625 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-1be6e244-1b68-4de0-846f-dbc30e0942fe tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] [instance: 5c8d5bc5-4671-4189-94e0-1442e872fc2d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:30.483295 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-1be6e244-1b68-4de0-846f-dbc30e0942fe tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:30.484212 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-1be6e244-1b68-4de0-846f-dbc30e0942fe tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:30.485657 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-1be6e244-1b68-4de0-846f-dbc30e0942fe tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:30.486529 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-1be6e244-1b68-4de0-846f-dbc30e0942fe tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:30.588744 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-1be6e244-1b68-4de0-846f-dbc30e0942fe tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad75a8b887a4a40accb49603f03c8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d27fbbe7475782fe2202e34aec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:30.596640 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-1be6e244-1b68-4de0-846f-dbc30e0942fe tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] 10.222.0.59 "GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d" status: 200 len: 1274 microversion: 2.1 time: 0.125191 Jun 30 10:40:30.597219 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 21/47] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:30 2022] GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d => generated 1274 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:30.845424 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-31d34717-4999-43f9-925d-883f24c779aa tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:30.846014 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-31d34717-4999-43f9-925d-883f24c779aa tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 6bc2024c-c05e-4409-a142-e8cf3191a203] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:30.852534 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-31d34717-4999-43f9-925d-883f24c779aa tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:30.853006 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-31d34717-4999-43f9-925d-883f24c779aa tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:30.853790 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-31d34717-4999-43f9-925d-883f24c779aa tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:30.854251 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-31d34717-4999-43f9-925d-883f24c779aa tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:30.970771 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-31d34717-4999-43f9-925d-883f24c779aa tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:30.974670 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_cell1:SELECT=100 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:30.982606 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-31d34717-4999-43f9-925d-883f24c779aa tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203" status: 200 len: 1244 microversion: 2.1 time: 0.141236 Jun 30 10:40:30.984550 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 27/48] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:30 2022] GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203 => generated 1244 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:31.134699 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-abef5707-8244-4625-9af3-a81492c7faa3 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:31.135309 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-abef5707-8244-4625-9af3-a81492c7faa3 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:31.142416 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-abef5707-8244-4625-9af3-a81492c7faa3 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:31.143166 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-abef5707-8244-4625-9af3-a81492c7faa3 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:31.144053 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-abef5707-8244-4625-9af3-a81492c7faa3 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:31.144491 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-abef5707-8244-4625-9af3-a81492c7faa3 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:31.240481 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-293b8879-8205-47a9-85e1-d0081010a719 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:31.241163 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-293b8879-8205-47a9-85e1-d0081010a719 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:31.241300 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-abef5707-8244-4625-9af3-a81492c7faa3 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:31.250986 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-293b8879-8205-47a9-85e1-d0081010a719 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:31.251438 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-293b8879-8205-47a9-85e1-d0081010a719 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:31.252062 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-abef5707-8244-4625-9af3-a81492c7faa3 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1241 microversion: 2.1 time: 0.120836 Jun 30 10:40:31.253007 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-293b8879-8205-47a9-85e1-d0081010a719 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:31.255022 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-293b8879-8205-47a9-85e1-d0081010a719 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:31.266148 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 22/49] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:31 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1241 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:31.403092 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-293b8879-8205-47a9-85e1-d0081010a719 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:31.411516 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-293b8879-8205-47a9-85e1-d0081010a719 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1321 microversion: 2.1 time: 0.175444 Jun 30 10:40:31.412115 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 28/50] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:31 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:40:31.475080 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-41766846-699e-4945-8f79-ec0ebce3d333 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:31.475852 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-41766846-699e-4945-8f79-ec0ebce3d333 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:31.479163 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:31.483439 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-41766846-699e-4945-8f79-ec0ebce3d333 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:31.483995 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-41766846-699e-4945-8f79-ec0ebce3d333 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:31.484862 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-41766846-699e-4945-8f79-ec0ebce3d333 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:31.485360 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-41766846-699e-4945-8f79-ec0ebce3d333 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:31.578528 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-41766846-699e-4945-8f79-ec0ebce3d333 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:31.587347 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-41766846-699e-4945-8f79-ec0ebce3d333 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:31.588963 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-41766846-699e-4945-8f79-ec0ebce3d333 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:31.590167 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-41766846-699e-4945-8f79-ec0ebce3d333 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1286 microversion: 2.20 time: 0.118967 Jun 30 10:40:31.590794 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 23/51] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:40:31 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1286 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:40:31.613683 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-5fb2727e-d58a-40a5-a147-dc135d33e081 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:31.614428 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-5fb2727e-d58a-40a5-a147-dc135d33e081 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] [instance: 5c8d5bc5-4671-4189-94e0-1442e872fc2d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:31.629557 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5fb2727e-d58a-40a5-a147-dc135d33e081 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:31.630243 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5fb2727e-d58a-40a5-a147-dc135d33e081 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:31.631042 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5fb2727e-d58a-40a5-a147-dc135d33e081 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:31.631483 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5fb2727e-d58a-40a5-a147-dc135d33e081 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:31.755274 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-5fb2727e-d58a-40a5-a147-dc135d33e081 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad75a8b887a4a40accb49603f03c8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d27fbbe7475782fe2202e34aec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:31.763200 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-5fb2727e-d58a-40a5-a147-dc135d33e081 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] 10.222.0.59 "GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d" status: 200 len: 1274 microversion: 2.1 time: 0.153357 Jun 30 10:40:31.764150 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 29/52] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:31 2022] GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d => generated 1274 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:32.002725 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-f523ec39-7e1f-41ac-b7a1-d2fc3e20a369 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:32.004154 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-f523ec39-7e1f-41ac-b7a1-d2fc3e20a369 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 6bc2024c-c05e-4409-a142-e8cf3191a203] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:32.017018 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-f523ec39-7e1f-41ac-b7a1-d2fc3e20a369 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:32.017771 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-f523ec39-7e1f-41ac-b7a1-d2fc3e20a369 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:32.018785 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-f523ec39-7e1f-41ac-b7a1-d2fc3e20a369 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:32.019225 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-f523ec39-7e1f-41ac-b7a1-d2fc3e20a369 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:32.096214 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-f523ec39-7e1f-41ac-b7a1-d2fc3e20a369 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:32.105038 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-f523ec39-7e1f-41ac-b7a1-d2fc3e20a369 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203" status: 200 len: 1244 microversion: 2.1 time: 0.107705 Jun 30 10:40:32.113937 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 24/53] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:31 2022] GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203 => generated 1244 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:32.283590 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-fa6d28bf-41bc-48ab-b690-e3ed04c79503 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:32.284862 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-fa6d28bf-41bc-48ab-b690-e3ed04c79503 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:32.296106 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-fa6d28bf-41bc-48ab-b690-e3ed04c79503 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:32.297106 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-fa6d28bf-41bc-48ab-b690-e3ed04c79503 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:32.297949 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-fa6d28bf-41bc-48ab-b690-e3ed04c79503 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:32.298413 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-fa6d28bf-41bc-48ab-b690-e3ed04c79503 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:32.392380 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-fa6d28bf-41bc-48ab-b690-e3ed04c79503 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:32.400161 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-fa6d28bf-41bc-48ab-b690-e3ed04c79503 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1241 microversion: 2.1 time: 0.120535 Jun 30 10:40:32.401862 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 30/54] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:32 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1241 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:32.429084 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-0f62d32a-2295-44e7-add6-183b8bf90e17 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:32.429620 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-0f62d32a-2295-44e7-add6-183b8bf90e17 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:32.435883 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0f62d32a-2295-44e7-add6-183b8bf90e17 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:32.436325 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0f62d32a-2295-44e7-add6-183b8bf90e17 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:32.437750 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0f62d32a-2295-44e7-add6-183b8bf90e17 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:32.438389 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0f62d32a-2295-44e7-add6-183b8bf90e17 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:32.602758 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-0f62d32a-2295-44e7-add6-183b8bf90e17 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:32.609800 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-c5781285-daae-443c-af4c-386ebab78d5b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:32.610425 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-c5781285-daae-443c-af4c-386ebab78d5b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:32.613451 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-0f62d32a-2295-44e7-add6-183b8bf90e17 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1321 microversion: 2.1 time: 0.188500 Jun 30 10:40:32.617338 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 25/55] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:32 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1321 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:32.623599 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c5781285-daae-443c-af4c-386ebab78d5b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:32.624218 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c5781285-daae-443c-af4c-386ebab78d5b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:32.625081 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c5781285-daae-443c-af4c-386ebab78d5b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:32.625522 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c5781285-daae-443c-af4c-386ebab78d5b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:32.698649 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-c5781285-daae-443c-af4c-386ebab78d5b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:32.711168 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-c5781285-daae-443c-af4c-386ebab78d5b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:32.713159 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-c5781285-daae-443c-af4c-386ebab78d5b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:32.714508 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-c5781285-daae-443c-af4c-386ebab78d5b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1286 microversion: 2.20 time: 0.109694 Jun 30 10:40:32.727234 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 31/56] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:40:32 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1286 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 10:40:32.786940 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-5e38c38d-ce71-4ad1-9127-af44d9d0796a tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:32.787918 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-5e38c38d-ce71-4ad1-9127-af44d9d0796a tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] [instance: 5c8d5bc5-4671-4189-94e0-1442e872fc2d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:32.799350 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-5e38c38d-ce71-4ad1-9127-af44d9d0796a tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:32.799830 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-5e38c38d-ce71-4ad1-9127-af44d9d0796a tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:32.800720 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-5e38c38d-ce71-4ad1-9127-af44d9d0796a tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:32.801235 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-5e38c38d-ce71-4ad1-9127-af44d9d0796a tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:32.872602 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-5e38c38d-ce71-4ad1-9127-af44d9d0796a tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad75a8b887a4a40accb49603f03c8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d27fbbe7475782fe2202e34aec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:32.886787 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-5e38c38d-ce71-4ad1-9127-af44d9d0796a tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] 10.222.0.59 "GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d" status: 200 len: 1274 microversion: 2.1 time: 0.106685 Jun 30 10:40:32.888837 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 26/57] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:32 2022] GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d => generated 1274 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:33.123599 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-f401a4fa-8b89-4211-8cae-6441929f6a7a tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:33.124402 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-f401a4fa-8b89-4211-8cae-6441929f6a7a tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 6bc2024c-c05e-4409-a142-e8cf3191a203] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:33.149551 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f401a4fa-8b89-4211-8cae-6441929f6a7a tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:33.150741 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f401a4fa-8b89-4211-8cae-6441929f6a7a tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:33.156836 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f401a4fa-8b89-4211-8cae-6441929f6a7a tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:33.158789 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f401a4fa-8b89-4211-8cae-6441929f6a7a tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:33.331153 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-f401a4fa-8b89-4211-8cae-6441929f6a7a tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:33.344063 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-f401a4fa-8b89-4211-8cae-6441929f6a7a tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203" status: 200 len: 1244 microversion: 2.1 time: 0.224731 Jun 30 10:40:33.345404 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 32/58] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:33 2022] GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203 => generated 1244 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:33.419296 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-f7711ff5-914a-44d7-b4a0-1d6f7172e8c9 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:33.420534 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-f7711ff5-914a-44d7-b4a0-1d6f7172e8c9 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:33.427490 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-f7711ff5-914a-44d7-b4a0-1d6f7172e8c9 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:33.428244 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-f7711ff5-914a-44d7-b4a0-1d6f7172e8c9 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:33.429456 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-f7711ff5-914a-44d7-b4a0-1d6f7172e8c9 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:33.430643 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-f7711ff5-914a-44d7-b4a0-1d6f7172e8c9 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:33.469943 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_cell1:SELECT=100 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:33.583293 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-f7711ff5-914a-44d7-b4a0-1d6f7172e8c9 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:33.606199 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-f7711ff5-914a-44d7-b4a0-1d6f7172e8c9 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1241 microversion: 2.1 time: 0.188972 Jun 30 10:40:33.606812 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 27/59] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:33 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1241 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:33.641746 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-5471aa18-1a8e-42af-838e-d95fb368392e tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:33.644228 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-5471aa18-1a8e-42af-838e-d95fb368392e tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:33.651558 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5471aa18-1a8e-42af-838e-d95fb368392e tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:33.652402 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5471aa18-1a8e-42af-838e-d95fb368392e tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:33.653574 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5471aa18-1a8e-42af-838e-d95fb368392e tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:33.654377 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5471aa18-1a8e-42af-838e-d95fb368392e tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:33.736132 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-30d62ba5-2b53-420f-b06b-c96d2c8963f7 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:33.740112 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-30d62ba5-2b53-420f-b06b-c96d2c8963f7 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:33.751910 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-30d62ba5-2b53-420f-b06b-c96d2c8963f7 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:33.753619 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-30d62ba5-2b53-420f-b06b-c96d2c8963f7 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:33.756758 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-30d62ba5-2b53-420f-b06b-c96d2c8963f7 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:33.757504 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-30d62ba5-2b53-420f-b06b-c96d2c8963f7 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:33.942674 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-30d62ba5-2b53-420f-b06b-c96d2c8963f7 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:33.951146 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-30d62ba5-2b53-420f-b06b-c96d2c8963f7 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:33.955549 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-30d62ba5-2b53-420f-b06b-c96d2c8963f7 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:33.958292 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-30d62ba5-2b53-420f-b06b-c96d2c8963f7 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1286 microversion: 2.20 time: 0.225564 Jun 30 10:40:33.961350 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 28/60] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:40:33 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1286 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:40:33.973987 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-0d812098-1bd3-4e23-bdc7-dcb22827241e tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:33.974652 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-0d812098-1bd3-4e23-bdc7-dcb22827241e tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] [instance: 5c8d5bc5-4671-4189-94e0-1442e872fc2d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:33.987426 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0d812098-1bd3-4e23-bdc7-dcb22827241e tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:33.988203 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0d812098-1bd3-4e23-bdc7-dcb22827241e tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:33.989233 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0d812098-1bd3-4e23-bdc7-dcb22827241e tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:33.989842 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0d812098-1bd3-4e23-bdc7-dcb22827241e tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:34.028328 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-5471aa18-1a8e-42af-838e-d95fb368392e tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:34.041596 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-5471aa18-1a8e-42af-838e-d95fb368392e tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1321 microversion: 2.1 time: 0.412399 Jun 30 10:40:34.042560 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 33/61] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:33 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1321 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:34.093839 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-0d812098-1bd3-4e23-bdc7-dcb22827241e tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad75a8b887a4a40accb49603f03c8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d27fbbe7475782fe2202e34aec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:34.103064 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-0d812098-1bd3-4e23-bdc7-dcb22827241e tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] 10.222.0.59 "GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d" status: 200 len: 1274 microversion: 2.1 time: 0.140341 Jun 30 10:40:34.104311 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 29/62] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:33 2022] GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d => generated 1274 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:34.362950 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-b027d99a-7069-4800-b300-f90d34995640 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:34.364290 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-b027d99a-7069-4800-b300-f90d34995640 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 6bc2024c-c05e-4409-a142-e8cf3191a203] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:34.373143 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-b027d99a-7069-4800-b300-f90d34995640 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:34.373877 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-b027d99a-7069-4800-b300-f90d34995640 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:34.375305 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-b027d99a-7069-4800-b300-f90d34995640 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:34.375958 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-b027d99a-7069-4800-b300-f90d34995640 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:34.461866 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-b027d99a-7069-4800-b300-f90d34995640 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:34.473144 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-b027d99a-7069-4800-b300-f90d34995640 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203" status: 200 len: 1244 microversion: 2.1 time: 0.114954 Jun 30 10:40:34.483508 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 34/63] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:34 2022] GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203 => generated 1244 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:34.518549 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [req-e30b796d-c8fe-4b97-81ce-b3874890ca1d req-4a17673c-ee55-4081-b2aa-e5f35614ff77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecd0d1a0-003c-4199-984a-80b41602909f", "tag": "8f7bc5c0-f904-466a-8e66-4bf59256553e"}]} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:40:34.530482 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-e30b796d-c8fe-4b97-81ce-b3874890ca1d req-4a17673c-ee55-4081-b2aa-e5f35614ff77 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:34.531716 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-e30b796d-c8fe-4b97-81ce-b3874890ca1d req-4a17673c-ee55-4081-b2aa-e5f35614ff77 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:34.553057 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.compute.server_external_events [req-e30b796d-c8fe-4b97-81ce-b3874890ca1d req-4a17673c-ee55-4081-b2aa-e5f35614ff77 service nova] Creating event network-changed:8f7bc5c0-f904-466a-8e66-4bf59256553e for instance ecd0d1a0-003c-4199-984a-80b41602909f on hv-cinder-82282 Jun 30 10:40:34.553592 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-e30b796d-c8fe-4b97-81ce-b3874890ca1d req-4a17673c-ee55-4081-b2aa-e5f35614ff77 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124203) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 30 10:40:34.554706 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a9aeef97-e0a7-437d-8416-0b84494745a9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:34.555140 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a9aeef97-e0a7-437d-8416-0b84494745a9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:34.555948 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a9aeef97-e0a7-437d-8416-0b84494745a9 None None] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:34.556373 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a9aeef97-e0a7-437d-8416-0b84494745a9 None None] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:34.566157 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.compute.rpcapi [None req-a9aeef97-e0a7-437d-8416-0b84494745a9 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 30 10:40:34.567046 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a9aeef97-e0a7-437d-8416-0b84494745a9 None None] Releasing lock "compute-rpcapi-router" {{(pid=124203) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 30 10:40:34.584029 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-a9aeef97-e0a7-437d-8416-0b84494745a9 None None] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071178 Jun 30 10:40:34.585163 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 30/64] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:40:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:40:34.622880 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-66b18a98-0b1a-4488-b06f-de23a8747b6e tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:34.623873 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-66b18a98-0b1a-4488-b06f-de23a8747b6e tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:34.630375 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-66b18a98-0b1a-4488-b06f-de23a8747b6e tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:34.631146 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-66b18a98-0b1a-4488-b06f-de23a8747b6e tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:34.632120 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-66b18a98-0b1a-4488-b06f-de23a8747b6e tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:34.633057 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-66b18a98-0b1a-4488-b06f-de23a8747b6e tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:34.705073 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-66b18a98-0b1a-4488-b06f-de23a8747b6e tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:34.713754 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-66b18a98-0b1a-4488-b06f-de23a8747b6e tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1241 microversion: 2.1 time: 0.094633 Jun 30 10:40:34.714341 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 35/65] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:34 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1241 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:34.977003 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-dd7d595a-5bc3-47f6-9aa3-79cb2368ed0c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:34.977722 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-dd7d595a-5bc3-47f6-9aa3-79cb2368ed0c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:34.984959 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-dd7d595a-5bc3-47f6-9aa3-79cb2368ed0c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:34.985397 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-dd7d595a-5bc3-47f6-9aa3-79cb2368ed0c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:34.986359 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-dd7d595a-5bc3-47f6-9aa3-79cb2368ed0c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:34.986793 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-dd7d595a-5bc3-47f6-9aa3-79cb2368ed0c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:35.059212 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-4528dcaf-6a77-47d2-878d-7eea026aaf80 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:35.059755 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-4528dcaf-6a77-47d2-878d-7eea026aaf80 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:35.067372 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-dd7d595a-5bc3-47f6-9aa3-79cb2368ed0c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:35.068303 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-4528dcaf-6a77-47d2-878d-7eea026aaf80 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:35.068786 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-4528dcaf-6a77-47d2-878d-7eea026aaf80 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:35.070002 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-4528dcaf-6a77-47d2-878d-7eea026aaf80 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:35.070656 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-4528dcaf-6a77-47d2-878d-7eea026aaf80 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:35.079959 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-dd7d595a-5bc3-47f6-9aa3-79cb2368ed0c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:35.082562 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-dd7d595a-5bc3-47f6-9aa3-79cb2368ed0c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:35.084919 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-dd7d595a-5bc3-47f6-9aa3-79cb2368ed0c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1286 microversion: 2.20 time: 0.112578 Jun 30 10:40:35.096244 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 31/66] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:40:34 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1286 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:40:35.125271 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-58d346cc-6c92-4e41-be9c-a4487b48ebd2 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:35.126116 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-58d346cc-6c92-4e41-be9c-a4487b48ebd2 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] [instance: 5c8d5bc5-4671-4189-94e0-1442e872fc2d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:35.139552 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-58d346cc-6c92-4e41-be9c-a4487b48ebd2 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:35.142050 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-58d346cc-6c92-4e41-be9c-a4487b48ebd2 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:35.143716 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-58d346cc-6c92-4e41-be9c-a4487b48ebd2 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:35.145811 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-58d346cc-6c92-4e41-be9c-a4487b48ebd2 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:35.293556 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-58d346cc-6c92-4e41-be9c-a4487b48ebd2 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad75a8b887a4a40accb49603f03c8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d27fbbe7475782fe2202e34aec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:35.303241 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-58d346cc-6c92-4e41-be9c-a4487b48ebd2 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] 10.222.0.59 "GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d" status: 200 len: 1274 microversion: 2.1 time: 0.185825 Jun 30 10:40:35.313230 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 32/67] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:35 2022] GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d => generated 1274 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:35.324553 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-4528dcaf-6a77-47d2-878d-7eea026aaf80 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:35.334476 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-4528dcaf-6a77-47d2-878d-7eea026aaf80 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1321 microversion: 2.1 time: 0.279133 Jun 30 10:40:35.335068 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 36/68] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:35 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1321 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:40:35.491163 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-81642abd-78f3-40b3-95b5-634226ba6971 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:35.491744 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-81642abd-78f3-40b3-95b5-634226ba6971 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 6bc2024c-c05e-4409-a142-e8cf3191a203] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:35.497705 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-81642abd-78f3-40b3-95b5-634226ba6971 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:35.498152 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-81642abd-78f3-40b3-95b5-634226ba6971 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:35.498900 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-81642abd-78f3-40b3-95b5-634226ba6971 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:35.499337 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-81642abd-78f3-40b3-95b5-634226ba6971 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:35.561412 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-81642abd-78f3-40b3-95b5-634226ba6971 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:35.569509 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-81642abd-78f3-40b3-95b5-634226ba6971 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203" status: 200 len: 1244 microversion: 2.1 time: 0.082352 Jun 30 10:40:35.570024 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 33/69] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:35 2022] GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203 => generated 1244 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:35.731454 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-a035e176-942a-4290-937e-5f7265d174f6 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:35.732065 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-a035e176-942a-4290-937e-5f7265d174f6 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:35.738766 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a035e176-942a-4290-937e-5f7265d174f6 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:35.739212 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a035e176-942a-4290-937e-5f7265d174f6 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:35.739968 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a035e176-942a-4290-937e-5f7265d174f6 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:35.740405 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a035e176-942a-4290-937e-5f7265d174f6 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:35.801243 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-a035e176-942a-4290-937e-5f7265d174f6 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:35.808694 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-a035e176-942a-4290-937e-5f7265d174f6 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1241 microversion: 2.1 time: 0.081395 Jun 30 10:40:35.809960 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 37/70] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:35 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1241 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:36.103118 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-c59dfc84-f3e9-4829-a89e-bc2042b0a4b0 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:36.103628 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-c59dfc84-f3e9-4829-a89e-bc2042b0a4b0 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:36.109935 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c59dfc84-f3e9-4829-a89e-bc2042b0a4b0 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:36.110402 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c59dfc84-f3e9-4829-a89e-bc2042b0a4b0 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:36.111159 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c59dfc84-f3e9-4829-a89e-bc2042b0a4b0 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:36.111591 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c59dfc84-f3e9-4829-a89e-bc2042b0a4b0 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:36.180048 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-c59dfc84-f3e9-4829-a89e-bc2042b0a4b0 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:36.188008 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-c59dfc84-f3e9-4829-a89e-bc2042b0a4b0 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:36.189531 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-c59dfc84-f3e9-4829-a89e-bc2042b0a4b0 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:36.190616 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-c59dfc84-f3e9-4829-a89e-bc2042b0a4b0 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1286 microversion: 2.20 time: 0.091466 Jun 30 10:40:36.191169 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 34/71] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:40:36 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1286 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:40:36.320720 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-d850128e-baaf-4f26-bfbd-ed1412ba8e6e tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:36.321333 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-d850128e-baaf-4f26-bfbd-ed1412ba8e6e tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] [instance: 5c8d5bc5-4671-4189-94e0-1442e872fc2d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:36.328165 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d850128e-baaf-4f26-bfbd-ed1412ba8e6e tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:36.328705 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d850128e-baaf-4f26-bfbd-ed1412ba8e6e tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:36.329475 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d850128e-baaf-4f26-bfbd-ed1412ba8e6e tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:36.329916 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d850128e-baaf-4f26-bfbd-ed1412ba8e6e tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:36.351179 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-632a6158-488f-41aa-abb1-0c9f0deac2c2 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:36.351949 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-632a6158-488f-41aa-abb1-0c9f0deac2c2 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:36.359554 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-632a6158-488f-41aa-abb1-0c9f0deac2c2 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:36.360209 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-632a6158-488f-41aa-abb1-0c9f0deac2c2 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:36.370858 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-632a6158-488f-41aa-abb1-0c9f0deac2c2 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:36.373400 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-632a6158-488f-41aa-abb1-0c9f0deac2c2 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:36.424628 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-d850128e-baaf-4f26-bfbd-ed1412ba8e6e tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad75a8b887a4a40accb49603f03c8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d27fbbe7475782fe2202e34aec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:36.433235 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-d850128e-baaf-4f26-bfbd-ed1412ba8e6e tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] 10.222.0.59 "GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d" status: 200 len: 1274 microversion: 2.1 time: 0.116318 Jun 30 10:40:36.436077 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 38/72] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:36 2022] GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d => generated 1274 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:36.586647 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-c491f567-19f9-4e4a-b1ee-5cb507450577 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:36.587235 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-632a6158-488f-41aa-abb1-0c9f0deac2c2 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:36.587676 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-c491f567-19f9-4e4a-b1ee-5cb507450577 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 6bc2024c-c05e-4409-a142-e8cf3191a203] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:36.595393 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c491f567-19f9-4e4a-b1ee-5cb507450577 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:36.596112 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-632a6158-488f-41aa-abb1-0c9f0deac2c2 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1321 microversion: 2.1 time: 0.248756 Jun 30 10:40:36.596271 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c491f567-19f9-4e4a-b1ee-5cb507450577 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:36.597331 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c491f567-19f9-4e4a-b1ee-5cb507450577 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:36.597946 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c491f567-19f9-4e4a-b1ee-5cb507450577 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:36.598421 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 35/73] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:36 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1321 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:40:36.675694 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-c491f567-19f9-4e4a-b1ee-5cb507450577 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:36.685577 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-c491f567-19f9-4e4a-b1ee-5cb507450577 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203" status: 200 len: 1244 microversion: 2.1 time: 0.102990 Jun 30 10:40:36.686695 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 39/74] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:36 2022] GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203 => generated 1244 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:40:36.833603 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-c20b4614-c512-4ad5-9201-cabe04834060 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:36.834202 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-c20b4614-c512-4ad5-9201-cabe04834060 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:36.845951 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c20b4614-c512-4ad5-9201-cabe04834060 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:36.846443 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c20b4614-c512-4ad5-9201-cabe04834060 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:36.847248 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c20b4614-c512-4ad5-9201-cabe04834060 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:36.847664 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c20b4614-c512-4ad5-9201-cabe04834060 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:36.912641 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-c20b4614-c512-4ad5-9201-cabe04834060 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:36.919871 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-c20b4614-c512-4ad5-9201-cabe04834060 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1241 microversion: 2.1 time: 0.094604 Jun 30 10:40:36.920428 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 36/75] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:36 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1241 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:37.208812 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-ec37014b-747f-48bc-91e4-a8236982d0f6 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:37.209525 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-ec37014b-747f-48bc-91e4-a8236982d0f6 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:37.211460 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_cell0:SELECT=32 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:37.217053 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ec37014b-747f-48bc-91e4-a8236982d0f6 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:37.217571 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ec37014b-747f-48bc-91e4-a8236982d0f6 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:37.218945 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ec37014b-747f-48bc-91e4-a8236982d0f6 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:37.219460 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ec37014b-747f-48bc-91e4-a8236982d0f6 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:37.299651 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-ec37014b-747f-48bc-91e4-a8236982d0f6 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:37.308495 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-ec37014b-747f-48bc-91e4-a8236982d0f6 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:37.310062 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-ec37014b-747f-48bc-91e4-a8236982d0f6 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:37.311185 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-ec37014b-747f-48bc-91e4-a8236982d0f6 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1286 microversion: 2.20 time: 0.106553 Jun 30 10:40:37.312163 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 40/76] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:40:37 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1286 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:40:37.454972 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-43918df6-fa7c-4931-a3a3-70b98786cbd7 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:37.455505 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-43918df6-fa7c-4931-a3a3-70b98786cbd7 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] [instance: 5c8d5bc5-4671-4189-94e0-1442e872fc2d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:37.457461 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_cell0:SELECT=28 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:37.463009 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-43918df6-fa7c-4931-a3a3-70b98786cbd7 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:37.463541 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-43918df6-fa7c-4931-a3a3-70b98786cbd7 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:37.464280 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-43918df6-fa7c-4931-a3a3-70b98786cbd7 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:37.464738 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-43918df6-fa7c-4931-a3a3-70b98786cbd7 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:37.524785 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-43918df6-fa7c-4931-a3a3-70b98786cbd7 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad75a8b887a4a40accb49603f03c8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d27fbbe7475782fe2202e34aec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:37.532809 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-43918df6-fa7c-4931-a3a3-70b98786cbd7 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] 10.222.0.59 "GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d" status: 200 len: 1274 microversion: 2.1 time: 0.082167 Jun 30 10:40:37.533379 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 37/77] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:37 2022] GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d => generated 1274 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:37.615076 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-15fed7b3-4cb2-44b7-971b-3d7a20546308 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:37.615896 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-15fed7b3-4cb2-44b7-971b-3d7a20546308 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:37.622006 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-15fed7b3-4cb2-44b7-971b-3d7a20546308 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:37.622456 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-15fed7b3-4cb2-44b7-971b-3d7a20546308 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:37.623378 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-15fed7b3-4cb2-44b7-971b-3d7a20546308 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:37.623876 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-15fed7b3-4cb2-44b7-971b-3d7a20546308 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:37.703378 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-a19cb6e0-470f-48bf-a2fe-3b675ec7ea33 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:37.704011 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-a19cb6e0-470f-48bf-a2fe-3b675ec7ea33 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 6bc2024c-c05e-4409-a142-e8cf3191a203] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:37.710096 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a19cb6e0-470f-48bf-a2fe-3b675ec7ea33 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:37.710627 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a19cb6e0-470f-48bf-a2fe-3b675ec7ea33 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:37.711458 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a19cb6e0-470f-48bf-a2fe-3b675ec7ea33 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:37.711964 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a19cb6e0-470f-48bf-a2fe-3b675ec7ea33 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:37.767159 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-15fed7b3-4cb2-44b7-971b-3d7a20546308 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:37.774586 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-15fed7b3-4cb2-44b7-971b-3d7a20546308 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1321 microversion: 2.1 time: 0.163254 Jun 30 10:40:37.775158 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 41/78] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:37 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:37.785978 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-a19cb6e0-470f-48bf-a2fe-3b675ec7ea33 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:37.793442 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-a19cb6e0-470f-48bf-a2fe-3b675ec7ea33 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203" status: 200 len: 1244 microversion: 2.1 time: 0.094446 Jun 30 10:40:37.794004 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 38/79] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:37 2022] GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203 => generated 1244 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:40:37.937398 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-29d10385-566d-4850-b92c-ae6b4c257442 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:37.938001 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-29d10385-566d-4850-b92c-ae6b4c257442 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:37.943905 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-29d10385-566d-4850-b92c-ae6b4c257442 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:37.944344 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-29d10385-566d-4850-b92c-ae6b4c257442 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:37.945124 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-29d10385-566d-4850-b92c-ae6b4c257442 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:37.945553 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-29d10385-566d-4850-b92c-ae6b4c257442 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:38.009874 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-29d10385-566d-4850-b92c-ae6b4c257442 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:38.018031 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-29d10385-566d-4850-b92c-ae6b4c257442 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1241 microversion: 2.1 time: 0.084995 Jun 30 10:40:38.018597 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 42/80] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:37 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1241 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:38.329334 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-3a101738-d8dc-42d7-bb2f-1de2ca07c5f7 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:38.329956 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-3a101738-d8dc-42d7-bb2f-1de2ca07c5f7 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:38.335935 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-3a101738-d8dc-42d7-bb2f-1de2ca07c5f7 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:38.336376 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-3a101738-d8dc-42d7-bb2f-1de2ca07c5f7 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:38.337162 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-3a101738-d8dc-42d7-bb2f-1de2ca07c5f7 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:38.337594 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-3a101738-d8dc-42d7-bb2f-1de2ca07c5f7 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:38.397520 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-3a101738-d8dc-42d7-bb2f-1de2ca07c5f7 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:38.405163 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-3a101738-d8dc-42d7-bb2f-1de2ca07c5f7 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:38.406642 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-3a101738-d8dc-42d7-bb2f-1de2ca07c5f7 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:38.407725 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-3a101738-d8dc-42d7-bb2f-1de2ca07c5f7 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1286 microversion: 2.20 time: 0.082331 Jun 30 10:40:38.408278 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 39/81] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:40:38 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1286 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:40:38.550239 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-f3a6766b-2883-4b7e-9cc5-f6ff333a8252 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:38.550891 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-f3a6766b-2883-4b7e-9cc5-f6ff333a8252 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] [instance: 5c8d5bc5-4671-4189-94e0-1442e872fc2d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:38.557039 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f3a6766b-2883-4b7e-9cc5-f6ff333a8252 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:38.557478 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f3a6766b-2883-4b7e-9cc5-f6ff333a8252 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:38.558242 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f3a6766b-2883-4b7e-9cc5-f6ff333a8252 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:38.558671 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f3a6766b-2883-4b7e-9cc5-f6ff333a8252 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:38.625792 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-f3a6766b-2883-4b7e-9cc5-f6ff333a8252 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad75a8b887a4a40accb49603f03c8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d27fbbe7475782fe2202e34aec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:38.633529 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-f3a6766b-2883-4b7e-9cc5-f6ff333a8252 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] 10.222.0.59 "GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d" status: 200 len: 1274 microversion: 2.1 time: 0.087672 Jun 30 10:40:38.634586 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 43/82] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:38 2022] GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d => generated 1274 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:38.791606 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-fcad2789-0c8a-43e8-bf2c-b69495e8652d tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:38.792204 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-fcad2789-0c8a-43e8-bf2c-b69495e8652d tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:38.798860 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-fcad2789-0c8a-43e8-bf2c-b69495e8652d tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:38.799392 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-fcad2789-0c8a-43e8-bf2c-b69495e8652d tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:38.800046 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-fcad2789-0c8a-43e8-bf2c-b69495e8652d tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:38.800552 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-fcad2789-0c8a-43e8-bf2c-b69495e8652d tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:38.811362 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-bdd3c9f1-8995-41fa-99cc-ebebd5d68439 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:38.812126 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-bdd3c9f1-8995-41fa-99cc-ebebd5d68439 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 6bc2024c-c05e-4409-a142-e8cf3191a203] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:38.820333 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-bdd3c9f1-8995-41fa-99cc-ebebd5d68439 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:38.820333 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-bdd3c9f1-8995-41fa-99cc-ebebd5d68439 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:38.822617 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-bdd3c9f1-8995-41fa-99cc-ebebd5d68439 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:38.822617 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-bdd3c9f1-8995-41fa-99cc-ebebd5d68439 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:38.859882 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_cell1:SELECT=100 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:38.918274 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-bdd3c9f1-8995-41fa-99cc-ebebd5d68439 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:38.926817 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-bdd3c9f1-8995-41fa-99cc-ebebd5d68439 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203" status: 200 len: 1244 microversion: 2.1 time: 0.119930 Jun 30 10:40:38.927385 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 44/83] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:38 2022] GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203 => generated 1244 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:38.977942 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-fcad2789-0c8a-43e8-bf2c-b69495e8652d tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:38.985620 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-fcad2789-0c8a-43e8-bf2c-b69495e8652d tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1321 microversion: 2.1 time: 0.197792 Jun 30 10:40:38.986183 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 40/84] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:38 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1321 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:39.035316 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-7e28129d-1afe-41a8-be69-7c2b794f8058 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:39.035955 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-7e28129d-1afe-41a8-be69-7c2b794f8058 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:39.041982 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-7e28129d-1afe-41a8-be69-7c2b794f8058 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:39.042424 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-7e28129d-1afe-41a8-be69-7c2b794f8058 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:39.043179 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-7e28129d-1afe-41a8-be69-7c2b794f8058 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:39.043607 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-7e28129d-1afe-41a8-be69-7c2b794f8058 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:39.106030 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-7e28129d-1afe-41a8-be69-7c2b794f8058 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:39.113154 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-7e28129d-1afe-41a8-be69-7c2b794f8058 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1241 microversion: 2.1 time: 0.082399 Jun 30 10:40:39.113730 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 45/85] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:39 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1241 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:39.425504 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-510aebdb-bf8f-4b71-a667-19e016c1de6c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:39.426107 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-510aebdb-bf8f-4b71-a667-19e016c1de6c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:39.432008 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-510aebdb-bf8f-4b71-a667-19e016c1de6c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:39.432451 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-510aebdb-bf8f-4b71-a667-19e016c1de6c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:39.433238 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-510aebdb-bf8f-4b71-a667-19e016c1de6c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:39.433670 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-510aebdb-bf8f-4b71-a667-19e016c1de6c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:39.497382 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-510aebdb-bf8f-4b71-a667-19e016c1de6c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:39.506364 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-510aebdb-bf8f-4b71-a667-19e016c1de6c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:39.507837 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-510aebdb-bf8f-4b71-a667-19e016c1de6c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:39.508971 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-510aebdb-bf8f-4b71-a667-19e016c1de6c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1286 microversion: 2.20 time: 0.087338 Jun 30 10:40:39.509520 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 41/86] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:40:39 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1286 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 10:40:39.650754 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-73c42d32-1dcf-42d8-a330-ebebc876fc0a tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:39.651368 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-73c42d32-1dcf-42d8-a330-ebebc876fc0a tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] [instance: 5c8d5bc5-4671-4189-94e0-1442e872fc2d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:39.653774 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_cell0:SELECT=8 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:39.659994 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-73c42d32-1dcf-42d8-a330-ebebc876fc0a tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:39.660447 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-73c42d32-1dcf-42d8-a330-ebebc876fc0a tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:39.661236 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-73c42d32-1dcf-42d8-a330-ebebc876fc0a tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:39.661675 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-73c42d32-1dcf-42d8-a330-ebebc876fc0a tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:39.726322 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-73c42d32-1dcf-42d8-a330-ebebc876fc0a tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad75a8b887a4a40accb49603f03c8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d27fbbe7475782fe2202e34aec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:39.736791 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-73c42d32-1dcf-42d8-a330-ebebc876fc0a tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] 10.222.0.59 "GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d" status: 200 len: 1274 microversion: 2.1 time: 0.089691 Jun 30 10:40:39.737337 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 46/87] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:39 2022] GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d => generated 1274 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:39.943489 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-de14bf7e-7958-4cde-9d02-45d7c5786d29 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:39.944141 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-de14bf7e-7958-4cde-9d02-45d7c5786d29 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 6bc2024c-c05e-4409-a142-e8cf3191a203] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:39.950078 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-de14bf7e-7958-4cde-9d02-45d7c5786d29 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:39.950517 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-de14bf7e-7958-4cde-9d02-45d7c5786d29 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:39.951269 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-de14bf7e-7958-4cde-9d02-45d7c5786d29 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:39.951731 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-de14bf7e-7958-4cde-9d02-45d7c5786d29 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:40.003451 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-169e3704-c4e2-4b40-b8ac-50e3d78def2b tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:40.004818 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-169e3704-c4e2-4b40-b8ac-50e3d78def2b tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:40.011004 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-169e3704-c4e2-4b40-b8ac-50e3d78def2b tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:40.011514 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-169e3704-c4e2-4b40-b8ac-50e3d78def2b tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:40.012367 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-169e3704-c4e2-4b40-b8ac-50e3d78def2b tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:40.012885 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-169e3704-c4e2-4b40-b8ac-50e3d78def2b tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:40.013490 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-de14bf7e-7958-4cde-9d02-45d7c5786d29 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:40.022090 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-de14bf7e-7958-4cde-9d02-45d7c5786d29 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203" status: 200 len: 1244 microversion: 2.1 time: 0.082302 Jun 30 10:40:40.022978 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 42/88] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:39 2022] GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203 => generated 1244 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:40.129610 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-7e388900-ac77-45f5-b34b-856edfa729ff tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:40.130223 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-7e388900-ac77-45f5-b34b-856edfa729ff tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:40.136154 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-7e388900-ac77-45f5-b34b-856edfa729ff tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:40.136779 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-7e388900-ac77-45f5-b34b-856edfa729ff tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:40.137582 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-7e388900-ac77-45f5-b34b-856edfa729ff tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:40.138018 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-7e388900-ac77-45f5-b34b-856edfa729ff tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:40.154946 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-169e3704-c4e2-4b40-b8ac-50e3d78def2b tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:40.177643 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-169e3704-c4e2-4b40-b8ac-50e3d78def2b tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1321 microversion: 2.1 time: 0.178754 Jun 30 10:40:40.188786 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 47/89] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:39 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1321 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:40:40.223722 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-7e388900-ac77-45f5-b34b-856edfa729ff tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:40.235882 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-7e388900-ac77-45f5-b34b-856edfa729ff tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1241 microversion: 2.1 time: 0.109943 Jun 30 10:40:40.241271 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 43/90] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:40 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1241 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:40:40.527656 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-164454e6-9a13-4641-88bd-8952f468b652 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:40.528262 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-164454e6-9a13-4641-88bd-8952f468b652 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:40.544148 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-164454e6-9a13-4641-88bd-8952f468b652 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:40.546092 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-164454e6-9a13-4641-88bd-8952f468b652 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:40.549044 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-164454e6-9a13-4641-88bd-8952f468b652 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:40.550084 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-164454e6-9a13-4641-88bd-8952f468b652 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:40.755138 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-4ec2b7e6-8e78-42ed-9aca-50e77f4917fe tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:40.755795 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-4ec2b7e6-8e78-42ed-9aca-50e77f4917fe tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] [instance: 5c8d5bc5-4671-4189-94e0-1442e872fc2d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:40.765966 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-4ec2b7e6-8e78-42ed-9aca-50e77f4917fe tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:40.768870 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-4ec2b7e6-8e78-42ed-9aca-50e77f4917fe tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:40.769893 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-4ec2b7e6-8e78-42ed-9aca-50e77f4917fe tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:40.773258 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-4ec2b7e6-8e78-42ed-9aca-50e77f4917fe tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:40.777545 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-164454e6-9a13-4641-88bd-8952f468b652 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:40.791520 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-164454e6-9a13-4641-88bd-8952f468b652 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:40.797883 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-164454e6-9a13-4641-88bd-8952f468b652 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:40.801796 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-164454e6-9a13-4641-88bd-8952f468b652 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1334 microversion: 2.20 time: 0.276093 Jun 30 10:40:40.804596 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 48/91] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:40:40 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1334 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:40:40.828128 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_cell1:SELECT=100 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:41.039551 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-7e81a1b4-8a33-4e9e-b18b-f6eafa58b9b1 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:41.040307 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-7e81a1b4-8a33-4e9e-b18b-f6eafa58b9b1 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 6bc2024c-c05e-4409-a142-e8cf3191a203] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:41.047414 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-7e81a1b4-8a33-4e9e-b18b-f6eafa58b9b1 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:41.047609 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-7e81a1b4-8a33-4e9e-b18b-f6eafa58b9b1 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:41.048650 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-7e81a1b4-8a33-4e9e-b18b-f6eafa58b9b1 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:41.049096 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-7e81a1b4-8a33-4e9e-b18b-f6eafa58b9b1 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:41.051208 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-4ec2b7e6-8e78-42ed-9aca-50e77f4917fe tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad75a8b887a4a40accb49603f03c8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d27fbbe7475782fe2202e34aec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:41.060146 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-4ec2b7e6-8e78-42ed-9aca-50e77f4917fe tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] 10.222.0.59 "GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d" status: 200 len: 1272 microversion: 2.1 time: 0.310231 Jun 30 10:40:41.061598 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 44/92] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:40 2022] GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d => generated 1272 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:40:41.144078 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-7e81a1b4-8a33-4e9e-b18b-f6eafa58b9b1 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:41.151869 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-7e81a1b4-8a33-4e9e-b18b-f6eafa58b9b1 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203" status: 200 len: 1292 microversion: 2.1 time: 0.116360 Jun 30 10:40:41.152459 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 49/93] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:41 2022] GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203 => generated 1292 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:40:41.196034 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-586db2a5-9084-4c69-b89d-b6d4b9a2efb4 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:41.197061 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-586db2a5-9084-4c69-b89d-b6d4b9a2efb4 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:41.205174 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-586db2a5-9084-4c69-b89d-b6d4b9a2efb4 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:41.205921 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-586db2a5-9084-4c69-b89d-b6d4b9a2efb4 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:41.207054 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-586db2a5-9084-4c69-b89d-b6d4b9a2efb4 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:41.207725 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-586db2a5-9084-4c69-b89d-b6d4b9a2efb4 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:41.256487 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-aea97336-d85a-468b-8968-bb7706ad74ff tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:41.257466 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-aea97336-d85a-468b-8968-bb7706ad74ff tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:41.267441 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-aea97336-d85a-468b-8968-bb7706ad74ff tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:41.271254 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-aea97336-d85a-468b-8968-bb7706ad74ff tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:41.272808 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-aea97336-d85a-468b-8968-bb7706ad74ff tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:41.274686 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-aea97336-d85a-468b-8968-bb7706ad74ff tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:41.461910 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-aea97336-d85a-468b-8968-bb7706ad74ff tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:41.482775 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-aea97336-d85a-468b-8968-bb7706ad74ff tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1289 microversion: 2.1 time: 0.230713 Jun 30 10:40:41.488923 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 50/94] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:41 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1289 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:40:41.679949 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-586db2a5-9084-4c69-b89d-b6d4b9a2efb4 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:41.690571 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-586db2a5-9084-4c69-b89d-b6d4b9a2efb4 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1321 microversion: 2.1 time: 0.498990 Jun 30 10:40:41.691257 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 45/95] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:41 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1321 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:41.823741 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-ae422c4c-11dc-4d10-b651-e3ae718f3d20 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:41.840777 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-ae422c4c-11dc-4d10-b651-e3ae718f3d20 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:41.880844 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ae422c4c-11dc-4d10-b651-e3ae718f3d20 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:41.881293 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ae422c4c-11dc-4d10-b651-e3ae718f3d20 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:41.882064 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ae422c4c-11dc-4d10-b651-e3ae718f3d20 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:41.883122 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ae422c4c-11dc-4d10-b651-e3ae718f3d20 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:41.977321 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-ae422c4c-11dc-4d10-b651-e3ae718f3d20 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:41.987588 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-ae422c4c-11dc-4d10-b651-e3ae718f3d20 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:41.992810 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-ae422c4c-11dc-4d10-b651-e3ae718f3d20 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:42.004470 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-ae422c4c-11dc-4d10-b651-e3ae718f3d20 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1342 microversion: 2.20 time: 0.186498 Jun 30 10:40:42.035658 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 51/96] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:40:41 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1342 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:40:42.085740 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-18e3acd4-d493-4754-9d0a-e11eab91db8f tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:42.087864 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-18e3acd4-d493-4754-9d0a-e11eab91db8f tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] [instance: 5c8d5bc5-4671-4189-94e0-1442e872fc2d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:42.110329 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-18e3acd4-d493-4754-9d0a-e11eab91db8f tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:42.111158 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-18e3acd4-d493-4754-9d0a-e11eab91db8f tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:42.114889 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-18e3acd4-d493-4754-9d0a-e11eab91db8f tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:42.116833 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-18e3acd4-d493-4754-9d0a-e11eab91db8f tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:42.170772 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-5a55e333-569c-45d1-a0c5-7104c217b7d4 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:42.171427 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-5a55e333-569c-45d1-a0c5-7104c217b7d4 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 6bc2024c-c05e-4409-a142-e8cf3191a203] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:42.180360 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5a55e333-569c-45d1-a0c5-7104c217b7d4 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:42.180831 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5a55e333-569c-45d1-a0c5-7104c217b7d4 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:42.187254 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5a55e333-569c-45d1-a0c5-7104c217b7d4 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:42.187699 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5a55e333-569c-45d1-a0c5-7104c217b7d4 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:42.356833 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-18e3acd4-d493-4754-9d0a-e11eab91db8f tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad75a8b887a4a40accb49603f03c8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d27fbbe7475782fe2202e34aec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:42.363730 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-5a55e333-569c-45d1-a0c5-7104c217b7d4 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:42.370004 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-18e3acd4-d493-4754-9d0a-e11eab91db8f tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] 10.222.0.59 "GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d" status: 200 len: 1272 microversion: 2.1 time: 0.294337 Jun 30 10:40:42.371758 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-5a55e333-569c-45d1-a0c5-7104c217b7d4 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203" status: 200 len: 1310 microversion: 2.1 time: 0.206134 Jun 30 10:40:42.380382 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 52/97] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:42 2022] GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203 => generated 1310 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:42.382412 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 46/98] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:42 2022] GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d => generated 1272 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:42.503760 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-2a1565ad-973d-41e8-8e9f-f536d63252fa tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:42.504721 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-2a1565ad-973d-41e8-8e9f-f536d63252fa tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:42.512141 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-2a1565ad-973d-41e8-8e9f-f536d63252fa tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:42.512907 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-2a1565ad-973d-41e8-8e9f-f536d63252fa tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:42.513834 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-2a1565ad-973d-41e8-8e9f-f536d63252fa tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:42.514341 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-2a1565ad-973d-41e8-8e9f-f536d63252fa tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:42.601057 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-2a1565ad-973d-41e8-8e9f-f536d63252fa tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:42.611522 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-2a1565ad-973d-41e8-8e9f-f536d63252fa tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1295 microversion: 2.1 time: 0.113475 Jun 30 10:40:42.613123 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 53/99] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:42 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1295 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:42.707654 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-e876083e-89b6-49d8-b6a0-5b9b0d1c9371 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:42.708609 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-e876083e-89b6-49d8-b6a0-5b9b0d1c9371 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:42.715799 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e876083e-89b6-49d8-b6a0-5b9b0d1c9371 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:42.716321 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e876083e-89b6-49d8-b6a0-5b9b0d1c9371 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:42.717885 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e876083e-89b6-49d8-b6a0-5b9b0d1c9371 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:42.718914 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e876083e-89b6-49d8-b6a0-5b9b0d1c9371 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:42.903139 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-e876083e-89b6-49d8-b6a0-5b9b0d1c9371 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:42.913761 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-e876083e-89b6-49d8-b6a0-5b9b0d1c9371 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1321 microversion: 2.1 time: 0.209799 Jun 30 10:40:42.915296 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 47/100] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:42 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1321 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:43.027994 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-eaea5bfd-47d9-49d1-ad43-57b47e96ec44 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:43.028756 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-eaea5bfd-47d9-49d1-ad43-57b47e96ec44 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:43.037223 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-eaea5bfd-47d9-49d1-ad43-57b47e96ec44 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:43.037753 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-eaea5bfd-47d9-49d1-ad43-57b47e96ec44 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:43.038783 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-eaea5bfd-47d9-49d1-ad43-57b47e96ec44 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:43.039291 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-eaea5bfd-47d9-49d1-ad43-57b47e96ec44 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:43.167432 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-eaea5bfd-47d9-49d1-ad43-57b47e96ec44 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:43.177885 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-eaea5bfd-47d9-49d1-ad43-57b47e96ec44 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:43.179680 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-eaea5bfd-47d9-49d1-ad43-57b47e96ec44 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:43.181052 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-eaea5bfd-47d9-49d1-ad43-57b47e96ec44 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1340 microversion: 2.20 time: 0.158317 Jun 30 10:40:43.182627 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 54/101] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:40:43 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1340 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:40:43.392090 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-9ca39e89-4c22-4853-a910-3d1dd9c70615 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:43.401469 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-7cc2e835-625e-44d8-b122-0fa9a3f0a8e6 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:43.402926 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-7cc2e835-625e-44d8-b122-0fa9a3f0a8e6 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 6bc2024c-c05e-4409-a142-e8cf3191a203] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:43.404632 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-9ca39e89-4c22-4853-a910-3d1dd9c70615 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] [instance: 5c8d5bc5-4671-4189-94e0-1442e872fc2d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:43.424358 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-9ca39e89-4c22-4853-a910-3d1dd9c70615 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:43.424831 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-7cc2e835-625e-44d8-b122-0fa9a3f0a8e6 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:43.425810 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-9ca39e89-4c22-4853-a910-3d1dd9c70615 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:43.425943 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-7cc2e835-625e-44d8-b122-0fa9a3f0a8e6 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:43.426751 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-7cc2e835-625e-44d8-b122-0fa9a3f0a8e6 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:43.429047 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-9ca39e89-4c22-4853-a910-3d1dd9c70615 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:43.429510 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-9ca39e89-4c22-4853-a910-3d1dd9c70615 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:43.430854 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-7cc2e835-625e-44d8-b122-0fa9a3f0a8e6 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:43.562511 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-7cc2e835-625e-44d8-b122-0fa9a3f0a8e6 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:43.581621 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-7cc2e835-625e-44d8-b122-0fa9a3f0a8e6 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203" status: 200 len: 1298 microversion: 2.1 time: 0.185306 Jun 30 10:40:43.584396 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 55/102] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:43 2022] GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203 => generated 1298 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:43.630559 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-ed8da997-c21c-4e83-bf5b-e5480d0f4632 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:43.631311 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-ed8da997-c21c-4e83-bf5b-e5480d0f4632 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:43.637755 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ed8da997-c21c-4e83-bf5b-e5480d0f4632 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:43.638204 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ed8da997-c21c-4e83-bf5b-e5480d0f4632 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:43.638999 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ed8da997-c21c-4e83-bf5b-e5480d0f4632 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:43.639444 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ed8da997-c21c-4e83-bf5b-e5480d0f4632 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:43.717832 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-9ca39e89-4c22-4853-a910-3d1dd9c70615 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad75a8b887a4a40accb49603f03c8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d27fbbe7475782fe2202e34aec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:43.726507 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-9ca39e89-4c22-4853-a910-3d1dd9c70615 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] 10.222.0.59 "GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d" status: 200 len: 1314 microversion: 2.1 time: 0.340661 Jun 30 10:40:43.727333 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 48/103] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:43 2022] GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d => generated 1314 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:43.743545 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-ed8da997-c21c-4e83-bf5b-e5480d0f4632 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:43.763584 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-ed8da997-c21c-4e83-bf5b-e5480d0f4632 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1295 microversion: 2.1 time: 0.137313 Jun 30 10:40:43.764174 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 56/104] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:43 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1295 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:40:43.979673 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-e3226f25-61fb-4d04-a78b-056b00f347fb tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:43.981188 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-e3226f25-61fb-4d04-a78b-056b00f347fb tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:43.988460 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e3226f25-61fb-4d04-a78b-056b00f347fb tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:43.989251 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e3226f25-61fb-4d04-a78b-056b00f347fb tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:43.990146 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e3226f25-61fb-4d04-a78b-056b00f347fb tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:43.990684 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e3226f25-61fb-4d04-a78b-056b00f347fb tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:44.164264 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-e3226f25-61fb-4d04-a78b-056b00f347fb tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:44.171746 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-e3226f25-61fb-4d04-a78b-056b00f347fb tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1321 microversion: 2.1 time: 0.196461 Jun 30 10:40:44.173111 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 49/105] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:43 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1321 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:44.199364 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-fc8bd28b-5d7f-4bd8-a12e-bf2abaf5b19f tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:44.199960 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-fc8bd28b-5d7f-4bd8-a12e-bf2abaf5b19f tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:44.206936 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-fc8bd28b-5d7f-4bd8-a12e-bf2abaf5b19f tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:44.207578 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-fc8bd28b-5d7f-4bd8-a12e-bf2abaf5b19f tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:44.208520 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-fc8bd28b-5d7f-4bd8-a12e-bf2abaf5b19f tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:44.208958 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-fc8bd28b-5d7f-4bd8-a12e-bf2abaf5b19f tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:44.498120 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-fc8bd28b-5d7f-4bd8-a12e-bf2abaf5b19f tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:44.511555 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-fc8bd28b-5d7f-4bd8-a12e-bf2abaf5b19f tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:44.513864 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-fc8bd28b-5d7f-4bd8-a12e-bf2abaf5b19f tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:44.515178 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-fc8bd28b-5d7f-4bd8-a12e-bf2abaf5b19f tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1407 microversion: 2.20 time: 0.319683 Jun 30 10:40:44.515775 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 57/106] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:40:44 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1407 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:40:44.602646 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-2e4bcd13-c43d-413a-acec-e763023b729a tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:44.603310 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-2e4bcd13-c43d-413a-acec-e763023b729a tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 6bc2024c-c05e-4409-a142-e8cf3191a203] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:44.605834 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_cell0:SELECT=8 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:44.613378 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-2e4bcd13-c43d-413a-acec-e763023b729a tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:44.614180 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-2e4bcd13-c43d-413a-acec-e763023b729a tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:44.615021 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-2e4bcd13-c43d-413a-acec-e763023b729a tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:44.615525 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-2e4bcd13-c43d-413a-acec-e763023b729a tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:44.692314 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-2e4bcd13-c43d-413a-acec-e763023b729a tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:44.704702 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-2e4bcd13-c43d-413a-acec-e763023b729a tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203" status: 200 len: 1298 microversion: 2.1 time: 0.107690 Jun 30 10:40:44.705365 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 50/107] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:44 2022] GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203 => generated 1298 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:44.742987 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-1734ab15-444d-4239-baf8-c018fad793fa tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:44.743607 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-1734ab15-444d-4239-baf8-c018fad793fa tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] [instance: 5c8d5bc5-4671-4189-94e0-1442e872fc2d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:44.757703 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1734ab15-444d-4239-baf8-c018fad793fa tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:44.758359 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1734ab15-444d-4239-baf8-c018fad793fa tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:44.759311 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1734ab15-444d-4239-baf8-c018fad793fa tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:44.759893 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1734ab15-444d-4239-baf8-c018fad793fa tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:44.783071 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-c8362baa-a2f5-4e8d-8c5f-1dabbf7561d6 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:44.783882 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-c8362baa-a2f5-4e8d-8c5f-1dabbf7561d6 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:44.792000 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c8362baa-a2f5-4e8d-8c5f-1dabbf7561d6 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:44.792998 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c8362baa-a2f5-4e8d-8c5f-1dabbf7561d6 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:44.794895 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c8362baa-a2f5-4e8d-8c5f-1dabbf7561d6 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:44.795347 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c8362baa-a2f5-4e8d-8c5f-1dabbf7561d6 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:44.891036 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-c8362baa-a2f5-4e8d-8c5f-1dabbf7561d6 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:44.900082 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-c8362baa-a2f5-4e8d-8c5f-1dabbf7561d6 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1295 microversion: 2.1 time: 0.122844 Jun 30 10:40:44.901233 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 51/108] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:44 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1295 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:44.954284 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-1734ab15-444d-4239-baf8-c018fad793fa tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad75a8b887a4a40accb49603f03c8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d27fbbe7475782fe2202e34aec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:44.962865 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-1734ab15-444d-4239-baf8-c018fad793fa tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] 10.222.0.59 "GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d" status: 200 len: 1314 microversion: 2.1 time: 0.223637 Jun 30 10:40:44.972816 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 58/109] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:44 2022] GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:45.189299 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-a39262e7-6c45-44a5-a414-f2c6b943f61c tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:45.189903 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-a39262e7-6c45-44a5-a414-f2c6b943f61c tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:45.198335 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a39262e7-6c45-44a5-a414-f2c6b943f61c tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:45.199710 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a39262e7-6c45-44a5-a414-f2c6b943f61c tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:45.201180 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a39262e7-6c45-44a5-a414-f2c6b943f61c tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:45.201846 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a39262e7-6c45-44a5-a414-f2c6b943f61c tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:45.364896 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-a39262e7-6c45-44a5-a414-f2c6b943f61c tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:45.373398 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-a39262e7-6c45-44a5-a414-f2c6b943f61c tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1321 microversion: 2.1 time: 0.187945 Jun 30 10:40:45.375014 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 52/110] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:45 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1321 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:45.532701 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-86697bb6-9d0a-49f6-b7d9-1ea0f1d62c4b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:45.533922 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-86697bb6-9d0a-49f6-b7d9-1ea0f1d62c4b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:45.539937 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-86697bb6-9d0a-49f6-b7d9-1ea0f1d62c4b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:45.540604 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-86697bb6-9d0a-49f6-b7d9-1ea0f1d62c4b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:45.541506 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-86697bb6-9d0a-49f6-b7d9-1ea0f1d62c4b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:45.541940 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-86697bb6-9d0a-49f6-b7d9-1ea0f1d62c4b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:45.723447 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-5d7b09ce-5669-4c66-b346-a5dbbab62406 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:45.724301 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-5d7b09ce-5669-4c66-b346-a5dbbab62406 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 6bc2024c-c05e-4409-a142-e8cf3191a203] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:45.736775 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-5d7b09ce-5669-4c66-b346-a5dbbab62406 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:45.737336 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-5d7b09ce-5669-4c66-b346-a5dbbab62406 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:45.738259 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-5d7b09ce-5669-4c66-b346-a5dbbab62406 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:45.738750 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-5d7b09ce-5669-4c66-b346-a5dbbab62406 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:45.753801 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-86697bb6-9d0a-49f6-b7d9-1ea0f1d62c4b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:45.762232 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-86697bb6-9d0a-49f6-b7d9-1ea0f1d62c4b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:45.764719 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-86697bb6-9d0a-49f6-b7d9-1ea0f1d62c4b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:45.766112 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-86697bb6-9d0a-49f6-b7d9-1ea0f1d62c4b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1407 microversion: 2.20 time: 0.237249 Jun 30 10:40:45.767220 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 59/111] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:40:45 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1407 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 10:40:45.809179 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-5d7b09ce-5669-4c66-b346-a5dbbab62406 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:45.818373 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-5d7b09ce-5669-4c66-b346-a5dbbab62406 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203" status: 200 len: 1298 microversion: 2.1 time: 0.100831 Jun 30 10:40:45.819080 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 53/112] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:45 2022] GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203 => generated 1298 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:40:45.917784 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-7956d702-7740-47b2-a6d5-dcaafa6b46bb tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:45.919208 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-7956d702-7740-47b2-a6d5-dcaafa6b46bb tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:45.927742 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-7956d702-7740-47b2-a6d5-dcaafa6b46bb tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:45.928986 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-7956d702-7740-47b2-a6d5-dcaafa6b46bb tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:45.930268 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-7956d702-7740-47b2-a6d5-dcaafa6b46bb tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:45.931048 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-7956d702-7740-47b2-a6d5-dcaafa6b46bb tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:45.979544 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-3475fc12-7f5b-456a-9053-8ba2667b3020 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:45.981322 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-3475fc12-7f5b-456a-9053-8ba2667b3020 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] [instance: 5c8d5bc5-4671-4189-94e0-1442e872fc2d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:45.991964 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-3475fc12-7f5b-456a-9053-8ba2667b3020 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:45.992487 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-3475fc12-7f5b-456a-9053-8ba2667b3020 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:45.993358 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-3475fc12-7f5b-456a-9053-8ba2667b3020 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:45.994868 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-3475fc12-7f5b-456a-9053-8ba2667b3020 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:46.014653 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-7956d702-7740-47b2-a6d5-dcaafa6b46bb tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:46.024446 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-7956d702-7740-47b2-a6d5-dcaafa6b46bb tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1295 microversion: 2.1 time: 0.111489 Jun 30 10:40:46.025792 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 60/113] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:45 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1295 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:46.160539 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-3475fc12-7f5b-456a-9053-8ba2667b3020 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad75a8b887a4a40accb49603f03c8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d27fbbe7475782fe2202e34aec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:46.170381 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-3475fc12-7f5b-456a-9053-8ba2667b3020 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] 10.222.0.59 "GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d" status: 200 len: 1314 microversion: 2.1 time: 0.194512 Jun 30 10:40:46.172010 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 54/114] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:45 2022] GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:46.391349 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-fb3021db-dc6f-46f9-a042-29ddfec0761b tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:46.391963 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-fb3021db-dc6f-46f9-a042-29ddfec0761b tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:46.400230 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-fb3021db-dc6f-46f9-a042-29ddfec0761b tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:46.400735 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-fb3021db-dc6f-46f9-a042-29ddfec0761b tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:46.401500 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-fb3021db-dc6f-46f9-a042-29ddfec0761b tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:46.401933 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-fb3021db-dc6f-46f9-a042-29ddfec0761b tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:46.407891 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_cell1:SELECT=100 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:46.551462 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-fb3021db-dc6f-46f9-a042-29ddfec0761b tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:46.560674 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-fb3021db-dc6f-46f9-a042-29ddfec0761b tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1321 microversion: 2.1 time: 0.172960 Jun 30 10:40:46.561660 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 61/115] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:46 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1321 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:46.783831 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-75e92502-78c4-430d-829b-59e435709d95 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:46.785045 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-75e92502-78c4-430d-829b-59e435709d95 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:46.791461 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-75e92502-78c4-430d-829b-59e435709d95 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:46.792176 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-75e92502-78c4-430d-829b-59e435709d95 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:46.793224 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-75e92502-78c4-430d-829b-59e435709d95 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:46.793891 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-75e92502-78c4-430d-829b-59e435709d95 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:46.835765 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-69cfc694-fb35-4e11-9edc-15d9c5e20a9f tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:46.836725 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-69cfc694-fb35-4e11-9edc-15d9c5e20a9f tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 6bc2024c-c05e-4409-a142-e8cf3191a203] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:46.844330 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-69cfc694-fb35-4e11-9edc-15d9c5e20a9f tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:46.845313 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-69cfc694-fb35-4e11-9edc-15d9c5e20a9f tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:46.849699 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-69cfc694-fb35-4e11-9edc-15d9c5e20a9f tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:46.850412 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-69cfc694-fb35-4e11-9edc-15d9c5e20a9f tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:46.958673 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-69cfc694-fb35-4e11-9edc-15d9c5e20a9f tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:46.970932 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-69cfc694-fb35-4e11-9edc-15d9c5e20a9f tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203" status: 200 len: 1298 microversion: 2.1 time: 0.139508 Jun 30 10:40:46.971789 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 62/116] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:46 2022] GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203 => generated 1298 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:40:47.001005 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-75e92502-78c4-430d-829b-59e435709d95 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:47.009861 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-75e92502-78c4-430d-829b-59e435709d95 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:47.011638 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-75e92502-78c4-430d-829b-59e435709d95 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:47.012890 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-75e92502-78c4-430d-829b-59e435709d95 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1407 microversion: 2.20 time: 0.233593 Jun 30 10:40:47.013474 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 55/117] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:40:46 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1407 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:40:47.041736 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-f6ef6148-f7c8-489c-92fc-9da27ae1941b tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:47.042352 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-f6ef6148-f7c8-489c-92fc-9da27ae1941b tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:47.049502 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f6ef6148-f7c8-489c-92fc-9da27ae1941b tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:47.050155 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f6ef6148-f7c8-489c-92fc-9da27ae1941b tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:47.051098 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f6ef6148-f7c8-489c-92fc-9da27ae1941b tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:47.051683 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f6ef6148-f7c8-489c-92fc-9da27ae1941b tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:47.129691 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-f6ef6148-f7c8-489c-92fc-9da27ae1941b tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:47.138887 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-f6ef6148-f7c8-489c-92fc-9da27ae1941b tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1295 microversion: 2.1 time: 0.100944 Jun 30 10:40:47.139466 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 63/118] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:47 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1295 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:47.188156 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-c16c3ee0-7076-4874-b650-1856d39158fd tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:47.188796 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-c16c3ee0-7076-4874-b650-1856d39158fd tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] [instance: 5c8d5bc5-4671-4189-94e0-1442e872fc2d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:47.196670 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c16c3ee0-7076-4874-b650-1856d39158fd tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:47.197499 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c16c3ee0-7076-4874-b650-1856d39158fd tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:47.198841 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c16c3ee0-7076-4874-b650-1856d39158fd tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:47.199551 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c16c3ee0-7076-4874-b650-1856d39158fd tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:47.380374 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-c16c3ee0-7076-4874-b650-1856d39158fd tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad75a8b887a4a40accb49603f03c8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d27fbbe7475782fe2202e34aec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:47.389303 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-c16c3ee0-7076-4874-b650-1856d39158fd tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] 10.222.0.59 "GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d" status: 200 len: 1314 microversion: 2.1 time: 0.205436 Jun 30 10:40:47.397690 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 56/119] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:47 2022] GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:47.579299 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-9c22035a-bc2c-477c-b2be-c5755f031deb tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:47.580473 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-9c22035a-bc2c-477c-b2be-c5755f031deb tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:47.589943 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-9c22035a-bc2c-477c-b2be-c5755f031deb tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:47.591054 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-9c22035a-bc2c-477c-b2be-c5755f031deb tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:47.592792 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-9c22035a-bc2c-477c-b2be-c5755f031deb tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:47.594102 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-9c22035a-bc2c-477c-b2be-c5755f031deb tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:47.919206 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-9c22035a-bc2c-477c-b2be-c5755f031deb tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:47.929620 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-9c22035a-bc2c-477c-b2be-c5755f031deb tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1321 microversion: 2.1 time: 0.354817 Jun 30 10:40:47.930530 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 64/120] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:47 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1321 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:47.990088 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-46084ee6-2bfb-4e60-95f8-7a31eb1760da tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:47.991925 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-46084ee6-2bfb-4e60-95f8-7a31eb1760da tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 6bc2024c-c05e-4409-a142-e8cf3191a203] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:48.001284 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-46084ee6-2bfb-4e60-95f8-7a31eb1760da tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:48.002389 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-46084ee6-2bfb-4e60-95f8-7a31eb1760da tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:48.003616 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-46084ee6-2bfb-4e60-95f8-7a31eb1760da tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:48.004062 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-46084ee6-2bfb-4e60-95f8-7a31eb1760da tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:48.033438 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-3f7b1816-4ea4-466d-b694-8f301af3561b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:48.034429 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-3f7b1816-4ea4-466d-b694-8f301af3561b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:48.040995 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-3f7b1816-4ea4-466d-b694-8f301af3561b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:48.041732 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-3f7b1816-4ea4-466d-b694-8f301af3561b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:48.042696 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-3f7b1816-4ea4-466d-b694-8f301af3561b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:48.043331 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-3f7b1816-4ea4-466d-b694-8f301af3561b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:48.123347 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-46084ee6-2bfb-4e60-95f8-7a31eb1760da tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:48.134531 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-46084ee6-2bfb-4e60-95f8-7a31eb1760da tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203" status: 200 len: 1298 microversion: 2.1 time: 0.149186 Jun 30 10:40:48.151587 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 57/121] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:47 2022] GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203 => generated 1298 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:48.157503 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-17b038b6-617b-4a86-bfe4-6aad0c8a58ee tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:48.158369 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-17b038b6-617b-4a86-bfe4-6aad0c8a58ee tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:48.164987 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-17b038b6-617b-4a86-bfe4-6aad0c8a58ee tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:48.165713 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-17b038b6-617b-4a86-bfe4-6aad0c8a58ee tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:48.166757 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-17b038b6-617b-4a86-bfe4-6aad0c8a58ee tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:48.167373 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-17b038b6-617b-4a86-bfe4-6aad0c8a58ee tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:48.337795 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-17b038b6-617b-4a86-bfe4-6aad0c8a58ee tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:48.346038 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-17b038b6-617b-4a86-bfe4-6aad0c8a58ee tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1295 microversion: 2.1 time: 0.193004 Jun 30 10:40:48.347104 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 58/122] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:48 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1295 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:48.408480 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-ea124b06-b3a3-4830-858f-5caa3c1a0ce9 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:48.409422 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-ea124b06-b3a3-4830-858f-5caa3c1a0ce9 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] [instance: 5c8d5bc5-4671-4189-94e0-1442e872fc2d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:48.412842 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-3f7b1816-4ea4-466d-b694-8f301af3561b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:48.421601 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ea124b06-b3a3-4830-858f-5caa3c1a0ce9 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:48.422259 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ea124b06-b3a3-4830-858f-5caa3c1a0ce9 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:48.423279 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ea124b06-b3a3-4830-858f-5caa3c1a0ce9 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:48.423981 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-3f7b1816-4ea4-466d-b694-8f301af3561b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:48.425024 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ea124b06-b3a3-4830-858f-5caa3c1a0ce9 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:48.429627 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-3f7b1816-4ea4-466d-b694-8f301af3561b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:48.431536 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-3f7b1816-4ea4-466d-b694-8f301af3561b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1407 microversion: 2.20 time: 0.403490 Jun 30 10:40:48.433949 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 65/123] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:40:48 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1407 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:40:48.807905 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-ea124b06-b3a3-4830-858f-5caa3c1a0ce9 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad75a8b887a4a40accb49603f03c8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d27fbbe7475782fe2202e34aec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:48.822374 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-ea124b06-b3a3-4830-858f-5caa3c1a0ce9 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] 10.222.0.59 "GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d" status: 200 len: 1314 microversion: 2.1 time: 0.419256 Jun 30 10:40:48.832359 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 59/124] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:48 2022] GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d => generated 1314 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:48.948975 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-1231c325-783a-454d-be68-adb2f3052159 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:48.949672 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-1231c325-783a-454d-be68-adb2f3052159 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:48.958957 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1231c325-783a-454d-be68-adb2f3052159 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:48.959977 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1231c325-783a-454d-be68-adb2f3052159 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:48.961044 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1231c325-783a-454d-be68-adb2f3052159 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:48.962428 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1231c325-783a-454d-be68-adb2f3052159 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:49.153477 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-1231c325-783a-454d-be68-adb2f3052159 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:49.153817 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-6d8d5aa5-35d8-4aef-87dc-9d10448f097b tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:49.156166 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-6d8d5aa5-35d8-4aef-87dc-9d10448f097b tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 6bc2024c-c05e-4409-a142-e8cf3191a203] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:49.165415 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-1231c325-783a-454d-be68-adb2f3052159 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1321 microversion: 2.1 time: 0.222285 Jun 30 10:40:49.167347 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-6d8d5aa5-35d8-4aef-87dc-9d10448f097b tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:49.168057 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-6d8d5aa5-35d8-4aef-87dc-9d10448f097b tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:49.171634 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-6d8d5aa5-35d8-4aef-87dc-9d10448f097b tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:49.172304 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-6d8d5aa5-35d8-4aef-87dc-9d10448f097b tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:49.177296 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 66/125] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:48 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1321 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:49.355451 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-6d8d5aa5-35d8-4aef-87dc-9d10448f097b tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:49.365868 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-826d7bfd-75cb-49cc-97d5-224f113a3bb3 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:49.366845 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-826d7bfd-75cb-49cc-97d5-224f113a3bb3 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:49.367990 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-6d8d5aa5-35d8-4aef-87dc-9d10448f097b tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203" status: 200 len: 1366 microversion: 2.1 time: 0.220244 Jun 30 10:40:49.369896 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 60/126] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:49 2022] GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203 => generated 1366 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:49.386087 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-826d7bfd-75cb-49cc-97d5-224f113a3bb3 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:49.386087 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-826d7bfd-75cb-49cc-97d5-224f113a3bb3 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:49.386087 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-826d7bfd-75cb-49cc-97d5-224f113a3bb3 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:49.386087 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-826d7bfd-75cb-49cc-97d5-224f113a3bb3 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:49.453942 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-c3965346-1d9e-4703-9a5b-c49997a06a0a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:49.454736 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-c3965346-1d9e-4703-9a5b-c49997a06a0a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:49.465572 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c3965346-1d9e-4703-9a5b-c49997a06a0a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:49.466353 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c3965346-1d9e-4703-9a5b-c49997a06a0a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:49.467389 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c3965346-1d9e-4703-9a5b-c49997a06a0a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:49.468461 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c3965346-1d9e-4703-9a5b-c49997a06a0a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:49.474000 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_cell1:SELECT=100 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:49.776238 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-826d7bfd-75cb-49cc-97d5-224f113a3bb3 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:49.790434 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-826d7bfd-75cb-49cc-97d5-224f113a3bb3 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1363 microversion: 2.1 time: 0.430128 Jun 30 10:40:49.791176 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 67/127] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:49 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1363 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:40:49.839217 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-68af44e0-a52b-41f3-baa4-85a66fab101c tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:49.839900 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-68af44e0-a52b-41f3-baa4-85a66fab101c tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] [instance: 5c8d5bc5-4671-4189-94e0-1442e872fc2d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:49.850140 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_api:SELECT=100 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:49.861365 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-68af44e0-a52b-41f3-baa4-85a66fab101c tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:49.861365 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-68af44e0-a52b-41f3-baa4-85a66fab101c tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:49.861885 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-c3965346-1d9e-4703-9a5b-c49997a06a0a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:49.868834 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-68af44e0-a52b-41f3-baa4-85a66fab101c tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:49.869505 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-68af44e0-a52b-41f3-baa4-85a66fab101c tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:49.870938 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-c3965346-1d9e-4703-9a5b-c49997a06a0a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:49.876539 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-c3965346-1d9e-4703-9a5b-c49997a06a0a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:49.881839 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-c3965346-1d9e-4703-9a5b-c49997a06a0a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1407 microversion: 2.20 time: 0.431220 Jun 30 10:40:49.900865 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 61/128] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:40:49 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1407 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 10:40:49.907380 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [req-eea8800b-dcf8-46bc-a4cf-34f790e2fa5f req-d49d8963-bd5d-45cb-b570-089ff4e4725d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af0d59b6-8e95-4947-803a-c1d952e218c8", "tag": "ec009e37-3070-46e8-8a9a-513065a2c654"}]} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:40:49.940594 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-eea8800b-dcf8-46bc-a4cf-34f790e2fa5f req-d49d8963-bd5d-45cb-b570-089ff4e4725d service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:49.945715 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-eea8800b-dcf8-46bc-a4cf-34f790e2fa5f req-d49d8963-bd5d-45cb-b570-089ff4e4725d service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:49.960926 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.compute.server_external_events [req-eea8800b-dcf8-46bc-a4cf-34f790e2fa5f req-d49d8963-bd5d-45cb-b570-089ff4e4725d service nova] Creating event network-changed:ec009e37-3070-46e8-8a9a-513065a2c654 for instance af0d59b6-8e95-4947-803a-c1d952e218c8 on hv-cinder-82282 Jun 30 10:40:49.979503 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [req-eea8800b-dcf8-46bc-a4cf-34f790e2fa5f req-d49d8963-bd5d-45cb-b570-089ff4e4725d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076077 Jun 30 10:40:49.979503 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 62/129] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:40:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:40:50.127452 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-68af44e0-a52b-41f3-baa4-85a66fab101c tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad75a8b887a4a40accb49603f03c8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d27fbbe7475782fe2202e34aec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:50.135557 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-68af44e0-a52b-41f3-baa4-85a66fab101c tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] 10.222.0.59 "GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d" status: 200 len: 1314 microversion: 2.1 time: 0.300167 Jun 30 10:40:50.145127 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 68/130] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:49 2022] GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d => generated 1314 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:40:50.184427 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-7d21dfff-38cf-4aba-ba78-6ce4fe443c91 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:50.185679 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-7d21dfff-38cf-4aba-ba78-6ce4fe443c91 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:50.199717 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-7d21dfff-38cf-4aba-ba78-6ce4fe443c91 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:50.200624 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-7d21dfff-38cf-4aba-ba78-6ce4fe443c91 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:50.204749 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-7d21dfff-38cf-4aba-ba78-6ce4fe443c91 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:50.211191 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-7d21dfff-38cf-4aba-ba78-6ce4fe443c91 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:50.385994 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-5f2f748d-116a-41bc-9174-83c263d696db tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:50.386647 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-5f2f748d-116a-41bc-9174-83c263d696db tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 6bc2024c-c05e-4409-a142-e8cf3191a203] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:50.394765 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5f2f748d-116a-41bc-9174-83c263d696db tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:50.395214 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5f2f748d-116a-41bc-9174-83c263d696db tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:50.396031 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5f2f748d-116a-41bc-9174-83c263d696db tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:50.396455 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5f2f748d-116a-41bc-9174-83c263d696db tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:50.543076 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-7d21dfff-38cf-4aba-ba78-6ce4fe443c91 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:50.553695 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-7d21dfff-38cf-4aba-ba78-6ce4fe443c91 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1321 microversion: 2.1 time: 0.374823 Jun 30 10:40:50.563273 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 63/131] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:50 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1321 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:50.629122 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-5f2f748d-116a-41bc-9174-83c263d696db tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:50.640067 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-5f2f748d-116a-41bc-9174-83c263d696db tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203" status: 200 len: 1366 microversion: 2.1 time: 0.257798 Jun 30 10:40:50.641395 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 69/132] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:50 2022] GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203 => generated 1366 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:50.808015 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-25ee5801-1087-4397-86bd-9aa79fa48cd5 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:50.808692 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-25ee5801-1087-4397-86bd-9aa79fa48cd5 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:50.816245 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-25ee5801-1087-4397-86bd-9aa79fa48cd5 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:50.817436 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-25ee5801-1087-4397-86bd-9aa79fa48cd5 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:50.818421 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-25ee5801-1087-4397-86bd-9aa79fa48cd5 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:50.819003 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-25ee5801-1087-4397-86bd-9aa79fa48cd5 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:50.900928 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-825c9806-ade0-4657-a65c-0c562200e063 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:50.901850 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-825c9806-ade0-4657-a65c-0c562200e063 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:50.911312 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-825c9806-ade0-4657-a65c-0c562200e063 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:50.913170 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-825c9806-ade0-4657-a65c-0c562200e063 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:50.914529 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-825c9806-ade0-4657-a65c-0c562200e063 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:50.915158 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-825c9806-ade0-4657-a65c-0c562200e063 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:50.979618 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-25ee5801-1087-4397-86bd-9aa79fa48cd5 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:50.988076 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-25ee5801-1087-4397-86bd-9aa79fa48cd5 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1363 microversion: 2.1 time: 0.184066 Jun 30 10:40:50.999575 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 64/133] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:50 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1363 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:51.132733 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-825c9806-ade0-4657-a65c-0c562200e063 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:51.142441 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-825c9806-ade0-4657-a65c-0c562200e063 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:51.143945 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-825c9806-ade0-4657-a65c-0c562200e063 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:51.145636 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-825c9806-ade0-4657-a65c-0c562200e063 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1407 microversion: 2.20 time: 0.249007 Jun 30 10:40:51.146667 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 70/134] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:40:50 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1407 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 10:40:51.157497 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-676eeadd-ecc8-4e23-820d-9d27929fb722 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:51.158289 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-676eeadd-ecc8-4e23-820d-9d27929fb722 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] [instance: 5c8d5bc5-4671-4189-94e0-1442e872fc2d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:51.164845 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-676eeadd-ecc8-4e23-820d-9d27929fb722 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:51.165296 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-676eeadd-ecc8-4e23-820d-9d27929fb722 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:51.166063 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-676eeadd-ecc8-4e23-820d-9d27929fb722 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:51.166502 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-676eeadd-ecc8-4e23-820d-9d27929fb722 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:51.364783 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-676eeadd-ecc8-4e23-820d-9d27929fb722 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad75a8b887a4a40accb49603f03c8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d27fbbe7475782fe2202e34aec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:51.375187 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-676eeadd-ecc8-4e23-820d-9d27929fb722 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] 10.222.0.59 "GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d" status: 200 len: 1314 microversion: 2.1 time: 0.225434 Jun 30 10:40:51.376122 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 65/135] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:51 2022] GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:51.571011 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-f381ed88-0dc9-4f20-97f1-c84ede03e698 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:51.571884 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-f381ed88-0dc9-4f20-97f1-c84ede03e698 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:51.580558 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f381ed88-0dc9-4f20-97f1-c84ede03e698 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:51.585056 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f381ed88-0dc9-4f20-97f1-c84ede03e698 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:51.586268 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f381ed88-0dc9-4f20-97f1-c84ede03e698 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:51.586818 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f381ed88-0dc9-4f20-97f1-c84ede03e698 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:51.658795 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-396b24fa-9219-45ac-82da-99f8b2e036ef tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:51.659886 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-396b24fa-9219-45ac-82da-99f8b2e036ef tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 6bc2024c-c05e-4409-a142-e8cf3191a203] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:51.670773 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-396b24fa-9219-45ac-82da-99f8b2e036ef tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:51.672719 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-396b24fa-9219-45ac-82da-99f8b2e036ef tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:51.679764 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-396b24fa-9219-45ac-82da-99f8b2e036ef tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:51.680755 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-396b24fa-9219-45ac-82da-99f8b2e036ef tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:51.802422 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-f381ed88-0dc9-4f20-97f1-c84ede03e698 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:51.818987 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-f381ed88-0dc9-4f20-97f1-c84ede03e698 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1321 microversion: 2.1 time: 0.251781 Jun 30 10:40:51.826654 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 71/136] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:51 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1321 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:51.947304 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-396b24fa-9219-45ac-82da-99f8b2e036ef tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:51.957489 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-396b24fa-9219-45ac-82da-99f8b2e036ef tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203" status: 200 len: 1366 microversion: 2.1 time: 0.301900 Jun 30 10:40:51.958724 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 66/137] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:51 2022] GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203 => generated 1366 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:40:52.010227 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-3c4ea301-b4dd-417d-b8e1-bb62fdd0a2f3 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:52.010844 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-3c4ea301-b4dd-417d-b8e1-bb62fdd0a2f3 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:52.020046 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-3c4ea301-b4dd-417d-b8e1-bb62fdd0a2f3 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:52.020530 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-3c4ea301-b4dd-417d-b8e1-bb62fdd0a2f3 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:52.021385 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-3c4ea301-b4dd-417d-b8e1-bb62fdd0a2f3 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:52.021994 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-3c4ea301-b4dd-417d-b8e1-bb62fdd0a2f3 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:52.158937 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [req-bcb27ad7-bd0e-4aa2-8d8f-eb46d8b3b986 req-e0f35fce-aa84-4695-b400-cc3d9feac08c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c8d5bc5-4671-4189-94e0-1442e872fc2d", "tag": "6f18de23-489e-4e05-88b1-28c018e4e789"}, {"name": "network-changed", "server_uuid": "a8379d7c-c539-4cb8-9c06-886aff24e725", "tag": "4d656245-ccde-4b1f-a74a-7077e762ec01"}, {"name": "network-changed", "server_uuid": "6bc2024c-c05e-4409-a142-e8cf3191a203", "tag": "90e52b50-5114-40c4-a042-20650fd1b094"}]} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:40:52.175202 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-bcb27ad7-bd0e-4aa2-8d8f-eb46d8b3b986 req-e0f35fce-aa84-4695-b400-cc3d9feac08c service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:52.175887 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-bcb27ad7-bd0e-4aa2-8d8f-eb46d8b3b986 req-e0f35fce-aa84-4695-b400-cc3d9feac08c service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:52.191948 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.compute.server_external_events [req-bcb27ad7-bd0e-4aa2-8d8f-eb46d8b3b986 req-e0f35fce-aa84-4695-b400-cc3d9feac08c service nova] Creating event network-changed:6f18de23-489e-4e05-88b1-28c018e4e789 for instance 5c8d5bc5-4671-4189-94e0-1442e872fc2d on hv-cinder-82282 Jun 30 10:40:52.192784 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.compute.server_external_events [req-bcb27ad7-bd0e-4aa2-8d8f-eb46d8b3b986 req-e0f35fce-aa84-4695-b400-cc3d9feac08c service nova] Creating event network-changed:4d656245-ccde-4b1f-a74a-7077e762ec01 for instance a8379d7c-c539-4cb8-9c06-886aff24e725 on hv-cinder-82282 Jun 30 10:40:52.193380 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.compute.server_external_events [req-bcb27ad7-bd0e-4aa2-8d8f-eb46d8b3b986 req-e0f35fce-aa84-4695-b400-cc3d9feac08c service nova] Creating event network-changed:90e52b50-5114-40c4-a042-20650fd1b094 for instance 6bc2024c-c05e-4409-a142-e8cf3191a203 on hv-cinder-82282 Jun 30 10:40:52.201893 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [req-bcb27ad7-bd0e-4aa2-8d8f-eb46d8b3b986 req-e0f35fce-aa84-4695-b400-cc3d9feac08c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.046928 Jun 30 10:40:52.207132 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 67/138] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:40:52 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 10:40:52.216748 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-e5e07652-774b-481f-8a9b-21c201d51ccf tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:52.218356 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-e5e07652-774b-481f-8a9b-21c201d51ccf tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:52.219327 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-3c4ea301-b4dd-417d-b8e1-bb62fdd0a2f3 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:52.225804 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e5e07652-774b-481f-8a9b-21c201d51ccf tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:52.226576 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e5e07652-774b-481f-8a9b-21c201d51ccf tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:52.227556 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e5e07652-774b-481f-8a9b-21c201d51ccf tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:52.228233 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e5e07652-774b-481f-8a9b-21c201d51ccf tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:52.236035 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-3c4ea301-b4dd-417d-b8e1-bb62fdd0a2f3 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1363 microversion: 2.1 time: 0.230027 Jun 30 10:40:52.239055 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 72/139] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:52 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1363 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:52.371903 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-e5e07652-774b-481f-8a9b-21c201d51ccf tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:52.381083 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-e5e07652-774b-481f-8a9b-21c201d51ccf tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:52.382573 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-e5e07652-774b-481f-8a9b-21c201d51ccf tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:52.383668 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-e5e07652-774b-481f-8a9b-21c201d51ccf tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1407 microversion: 2.20 time: 0.175181 Jun 30 10:40:52.384220 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 68/140] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:40:52 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:40:52.396773 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-11a6611b-9bde-4b62-8b2d-10262ae9e673 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:52.397307 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-11a6611b-9bde-4b62-8b2d-10262ae9e673 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] [instance: 5c8d5bc5-4671-4189-94e0-1442e872fc2d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:52.403102 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-11a6611b-9bde-4b62-8b2d-10262ae9e673 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:52.403542 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-11a6611b-9bde-4b62-8b2d-10262ae9e673 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:52.404317 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-11a6611b-9bde-4b62-8b2d-10262ae9e673 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:52.404789 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-11a6611b-9bde-4b62-8b2d-10262ae9e673 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:52.546402 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-11a6611b-9bde-4b62-8b2d-10262ae9e673 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad75a8b887a4a40accb49603f03c8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d27fbbe7475782fe2202e34aec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:52.554218 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-11a6611b-9bde-4b62-8b2d-10262ae9e673 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] 10.222.0.59 "GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d" status: 200 len: 1314 microversion: 2.1 time: 0.161232 Jun 30 10:40:52.554858 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 73/141] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:52 2022] GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:52.835072 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-b4502f40-cce0-4a28-9058-03ad3a103c27 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:52.835701 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-b4502f40-cce0-4a28-9058-03ad3a103c27 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:52.841900 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b4502f40-cce0-4a28-9058-03ad3a103c27 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:52.842407 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b4502f40-cce0-4a28-9058-03ad3a103c27 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:52.843698 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b4502f40-cce0-4a28-9058-03ad3a103c27 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:52.844172 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b4502f40-cce0-4a28-9058-03ad3a103c27 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:52.974939 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-d398e3f0-2303-4655-ae9e-fb3469d389c8 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:52.976054 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-d398e3f0-2303-4655-ae9e-fb3469d389c8 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 6bc2024c-c05e-4409-a142-e8cf3191a203] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:52.983670 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d398e3f0-2303-4655-ae9e-fb3469d389c8 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:52.983960 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d398e3f0-2303-4655-ae9e-fb3469d389c8 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:52.985641 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d398e3f0-2303-4655-ae9e-fb3469d389c8 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:52.986265 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d398e3f0-2303-4655-ae9e-fb3469d389c8 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:52.987659 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-b4502f40-cce0-4a28-9058-03ad3a103c27 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:52.995479 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-b4502f40-cce0-4a28-9058-03ad3a103c27 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1321 microversion: 2.1 time: 0.164167 Jun 30 10:40:52.996161 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 69/142] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:52 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:53.145642 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-d398e3f0-2303-4655-ae9e-fb3469d389c8 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:53.158403 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-d398e3f0-2303-4655-ae9e-fb3469d389c8 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203" status: 200 len: 1366 microversion: 2.1 time: 0.187217 Jun 30 10:40:53.159118 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 74/143] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:52 2022] GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203 => generated 1366 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:40:53.253044 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-93427769-d524-4d97-8591-575695d683fb tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:53.253875 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-93427769-d524-4d97-8591-575695d683fb tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:53.260470 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-93427769-d524-4d97-8591-575695d683fb tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:53.261724 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-93427769-d524-4d97-8591-575695d683fb tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:53.262488 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-93427769-d524-4d97-8591-575695d683fb tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:53.262917 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-93427769-d524-4d97-8591-575695d683fb tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:53.398304 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-93427769-d524-4d97-8591-575695d683fb tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:53.402333 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-7a76fbca-2e4a-4cd2-8c6a-6d6e18666d37 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:53.403424 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-7a76fbca-2e4a-4cd2-8c6a-6d6e18666d37 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:53.406914 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-93427769-d524-4d97-8591-575695d683fb tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1363 microversion: 2.1 time: 0.157795 Jun 30 10:40:53.407491 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 70/144] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:53 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:53.410604 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-7a76fbca-2e4a-4cd2-8c6a-6d6e18666d37 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:53.411220 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-7a76fbca-2e4a-4cd2-8c6a-6d6e18666d37 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:53.412135 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-7a76fbca-2e4a-4cd2-8c6a-6d6e18666d37 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:53.412743 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-7a76fbca-2e4a-4cd2-8c6a-6d6e18666d37 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:53.547227 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-7a76fbca-2e4a-4cd2-8c6a-6d6e18666d37 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:53.555230 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-7a76fbca-2e4a-4cd2-8c6a-6d6e18666d37 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:53.556770 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-7a76fbca-2e4a-4cd2-8c6a-6d6e18666d37 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:53.557884 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-7a76fbca-2e4a-4cd2-8c6a-6d6e18666d37 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1407 microversion: 2.20 time: 0.159482 Jun 30 10:40:53.558455 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 75/145] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:40:53 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:40:53.571086 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-bac81616-eeb9-41f3-a63e-8776afcd1158 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:53.571876 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-bac81616-eeb9-41f3-a63e-8776afcd1158 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] [instance: 5c8d5bc5-4671-4189-94e0-1442e872fc2d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:53.578096 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-bac81616-eeb9-41f3-a63e-8776afcd1158 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:53.578536 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-bac81616-eeb9-41f3-a63e-8776afcd1158 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:53.579316 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-bac81616-eeb9-41f3-a63e-8776afcd1158 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:53.579862 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-bac81616-eeb9-41f3-a63e-8776afcd1158 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:53.725303 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-bac81616-eeb9-41f3-a63e-8776afcd1158 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad75a8b887a4a40accb49603f03c8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d27fbbe7475782fe2202e34aec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:53.733051 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-bac81616-eeb9-41f3-a63e-8776afcd1158 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] 10.222.0.59 "GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d" status: 200 len: 1314 microversion: 2.1 time: 0.165862 Jun 30 10:40:53.733704 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 71/146] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:53 2022] GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:54.012291 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-ffeeda98-a454-46d6-bff4-50798a6b5fdc tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:54.012929 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-ffeeda98-a454-46d6-bff4-50798a6b5fdc tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:54.019008 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ffeeda98-a454-46d6-bff4-50798a6b5fdc tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:54.019536 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ffeeda98-a454-46d6-bff4-50798a6b5fdc tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:54.020382 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ffeeda98-a454-46d6-bff4-50798a6b5fdc tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:54.020872 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ffeeda98-a454-46d6-bff4-50798a6b5fdc tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:54.153339 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-ffeeda98-a454-46d6-bff4-50798a6b5fdc tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:54.160909 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-ffeeda98-a454-46d6-bff4-50798a6b5fdc tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1321 microversion: 2.1 time: 0.152382 Jun 30 10:40:54.161480 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 76/147] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:54 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:54.175607 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-ba6d10c8-f8d4-4166-a583-8ded814bfa76 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:54.176221 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-ba6d10c8-f8d4-4166-a583-8ded814bfa76 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 6bc2024c-c05e-4409-a142-e8cf3191a203] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:54.182144 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ba6d10c8-f8d4-4166-a583-8ded814bfa76 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:54.182592 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ba6d10c8-f8d4-4166-a583-8ded814bfa76 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:54.183358 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ba6d10c8-f8d4-4166-a583-8ded814bfa76 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:54.183791 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ba6d10c8-f8d4-4166-a583-8ded814bfa76 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:54.316229 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-ba6d10c8-f8d4-4166-a583-8ded814bfa76 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:54.327569 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-ba6d10c8-f8d4-4166-a583-8ded814bfa76 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203" status: 200 len: 1366 microversion: 2.1 time: 0.156212 Jun 30 10:40:54.328218 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 72/148] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:54 2022] GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:40:54.424932 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-1630dced-d4ae-4022-8bbf-4676ad7c52b4 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:54.425547 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-1630dced-d4ae-4022-8bbf-4676ad7c52b4 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:54.431873 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1630dced-d4ae-4022-8bbf-4676ad7c52b4 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:54.432319 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1630dced-d4ae-4022-8bbf-4676ad7c52b4 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:54.433125 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1630dced-d4ae-4022-8bbf-4676ad7c52b4 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:54.433564 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1630dced-d4ae-4022-8bbf-4676ad7c52b4 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:54.567180 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-1630dced-d4ae-4022-8bbf-4676ad7c52b4 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:54.570658 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_cell1:SELECT=100 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:54.576813 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-1630dced-d4ae-4022-8bbf-4676ad7c52b4 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1363 microversion: 2.1 time: 0.156281 Jun 30 10:40:54.576998 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-419fcdf2-c798-444f-9a17-95720c7284df tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:54.577481 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-419fcdf2-c798-444f-9a17-95720c7284df tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:54.586302 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 77/149] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:54 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:54.589909 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_api:SELECT=100 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:54.594257 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-419fcdf2-c798-444f-9a17-95720c7284df tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:54.594707 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-419fcdf2-c798-444f-9a17-95720c7284df tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:54.595477 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-419fcdf2-c798-444f-9a17-95720c7284df tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:54.595912 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-419fcdf2-c798-444f-9a17-95720c7284df tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:54.754197 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-3186999f-325f-4e42-b858-bb2a146143e8 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:54.755590 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-3186999f-325f-4e42-b858-bb2a146143e8 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] [instance: 5c8d5bc5-4671-4189-94e0-1442e872fc2d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:54.767099 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-3186999f-325f-4e42-b858-bb2a146143e8 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:54.768528 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-3186999f-325f-4e42-b858-bb2a146143e8 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:54.773355 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-3186999f-325f-4e42-b858-bb2a146143e8 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:54.773783 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-419fcdf2-c798-444f-9a17-95720c7284df tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:54.773919 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-3186999f-325f-4e42-b858-bb2a146143e8 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:54.784911 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-419fcdf2-c798-444f-9a17-95720c7284df tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:54.788319 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-419fcdf2-c798-444f-9a17-95720c7284df tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:54.789975 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-419fcdf2-c798-444f-9a17-95720c7284df tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1407 microversion: 2.20 time: 0.217139 Jun 30 10:40:54.802123 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 73/150] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:40:54 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1407 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:40:54.938965 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-3186999f-325f-4e42-b858-bb2a146143e8 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad75a8b887a4a40accb49603f03c8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d27fbbe7475782fe2202e34aec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:54.946955 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-3186999f-325f-4e42-b858-bb2a146143e8 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] 10.222.0.59 "GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d" status: 200 len: 1314 microversion: 2.1 time: 0.199771 Jun 30 10:40:54.947619 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 78/151] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:54 2022] GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:55.178160 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-802c2f4f-4633-4002-873e-f12fc07aa6dc tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:55.178856 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-802c2f4f-4633-4002-873e-f12fc07aa6dc tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:55.184952 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-802c2f4f-4633-4002-873e-f12fc07aa6dc tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:55.185391 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-802c2f4f-4633-4002-873e-f12fc07aa6dc tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:55.186128 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-802c2f4f-4633-4002-873e-f12fc07aa6dc tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:55.186553 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-802c2f4f-4633-4002-873e-f12fc07aa6dc tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:55.319783 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-802c2f4f-4633-4002-873e-f12fc07aa6dc tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:55.327996 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-802c2f4f-4633-4002-873e-f12fc07aa6dc tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1321 microversion: 2.1 time: 0.153708 Jun 30 10:40:55.328861 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 74/152] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:55 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:55.345023 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-76e7255e-c363-4abc-bdaa-6b040a161b74 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:55.345631 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-76e7255e-c363-4abc-bdaa-6b040a161b74 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 6bc2024c-c05e-4409-a142-e8cf3191a203] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:55.351677 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-76e7255e-c363-4abc-bdaa-6b040a161b74 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:55.352147 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-76e7255e-c363-4abc-bdaa-6b040a161b74 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:55.352935 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-76e7255e-c363-4abc-bdaa-6b040a161b74 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:55.353367 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-76e7255e-c363-4abc-bdaa-6b040a161b74 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:55.491374 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-76e7255e-c363-4abc-bdaa-6b040a161b74 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:55.498818 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-76e7255e-c363-4abc-bdaa-6b040a161b74 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203" status: 200 len: 1366 microversion: 2.1 time: 0.158563 Jun 30 10:40:55.499494 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 79/153] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:55 2022] GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:55.593852 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-e38781c8-24c2-4858-8aae-731eef9e6b96 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:55.594437 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-e38781c8-24c2-4858-8aae-731eef9e6b96 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:55.600328 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e38781c8-24c2-4858-8aae-731eef9e6b96 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:55.600807 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e38781c8-24c2-4858-8aae-731eef9e6b96 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:55.601552 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e38781c8-24c2-4858-8aae-731eef9e6b96 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:55.602034 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e38781c8-24c2-4858-8aae-731eef9e6b96 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:55.729584 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-e38781c8-24c2-4858-8aae-731eef9e6b96 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:55.737656 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-e38781c8-24c2-4858-8aae-731eef9e6b96 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1363 microversion: 2.1 time: 0.148271 Jun 30 10:40:55.738222 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 75/154] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:55 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:55.808301 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-1118f4d5-e6c7-4cf7-8360-a0bc894a43a4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:55.808949 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-1118f4d5-e6c7-4cf7-8360-a0bc894a43a4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:55.815558 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1118f4d5-e6c7-4cf7-8360-a0bc894a43a4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:55.816007 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1118f4d5-e6c7-4cf7-8360-a0bc894a43a4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:55.816822 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1118f4d5-e6c7-4cf7-8360-a0bc894a43a4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:55.817256 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1118f4d5-e6c7-4cf7-8360-a0bc894a43a4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:55.945948 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-1118f4d5-e6c7-4cf7-8360-a0bc894a43a4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:55.954418 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-1118f4d5-e6c7-4cf7-8360-a0bc894a43a4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:55.955918 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-1118f4d5-e6c7-4cf7-8360-a0bc894a43a4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:55.957054 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-1118f4d5-e6c7-4cf7-8360-a0bc894a43a4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1407 microversion: 2.20 time: 0.152576 Jun 30 10:40:55.957612 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 80/155] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:40:55 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:40:55.967365 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-02b22f0c-70c2-4d54-b501-6baad0497308 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:55.968064 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-02b22f0c-70c2-4d54-b501-6baad0497308 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] [instance: 5c8d5bc5-4671-4189-94e0-1442e872fc2d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:55.974050 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-02b22f0c-70c2-4d54-b501-6baad0497308 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:55.974496 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-02b22f0c-70c2-4d54-b501-6baad0497308 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:55.975262 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-02b22f0c-70c2-4d54-b501-6baad0497308 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:55.975696 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-02b22f0c-70c2-4d54-b501-6baad0497308 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:56.102907 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-02b22f0c-70c2-4d54-b501-6baad0497308 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad75a8b887a4a40accb49603f03c8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d27fbbe7475782fe2202e34aec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:56.110616 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-02b22f0c-70c2-4d54-b501-6baad0497308 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] 10.222.0.59 "GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d" status: 200 len: 1314 microversion: 2.1 time: 0.147038 Jun 30 10:40:56.111183 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 76/156] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:55 2022] GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:56.344746 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-16ebaa96-d0dc-4bf4-b3b1-9e691c64d6c0 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:56.345481 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-16ebaa96-d0dc-4bf4-b3b1-9e691c64d6c0 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:56.351884 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-16ebaa96-d0dc-4bf4-b3b1-9e691c64d6c0 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:56.352332 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-16ebaa96-d0dc-4bf4-b3b1-9e691c64d6c0 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:56.353128 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-16ebaa96-d0dc-4bf4-b3b1-9e691c64d6c0 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:56.353590 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-16ebaa96-d0dc-4bf4-b3b1-9e691c64d6c0 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:56.494658 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-16ebaa96-d0dc-4bf4-b3b1-9e691c64d6c0 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:56.502647 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-16ebaa96-d0dc-4bf4-b3b1-9e691c64d6c0 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1321 microversion: 2.1 time: 0.161822 Jun 30 10:40:56.503214 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 81/157] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:56 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:56.515066 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-8ccbeec0-2192-44c8-be13-bfd8aeff9e58 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:56.515606 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-8ccbeec0-2192-44c8-be13-bfd8aeff9e58 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 6bc2024c-c05e-4409-a142-e8cf3191a203] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:56.522086 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-8ccbeec0-2192-44c8-be13-bfd8aeff9e58 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:56.522622 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-8ccbeec0-2192-44c8-be13-bfd8aeff9e58 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:56.523303 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-8ccbeec0-2192-44c8-be13-bfd8aeff9e58 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:56.523739 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-8ccbeec0-2192-44c8-be13-bfd8aeff9e58 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:56.680050 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-8ccbeec0-2192-44c8-be13-bfd8aeff9e58 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:56.688005 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-8ccbeec0-2192-44c8-be13-bfd8aeff9e58 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203" status: 200 len: 1366 microversion: 2.1 time: 0.176767 Jun 30 10:40:56.688597 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 77/158] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:56 2022] GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203 => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:56.755708 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-61104287-cf10-4d7c-881b-65da89f0263e tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:56.760232 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-61104287-cf10-4d7c-881b-65da89f0263e tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:56.767788 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-61104287-cf10-4d7c-881b-65da89f0263e tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:56.768550 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-61104287-cf10-4d7c-881b-65da89f0263e tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:56.769973 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-61104287-cf10-4d7c-881b-65da89f0263e tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:56.778260 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-61104287-cf10-4d7c-881b-65da89f0263e tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:56.937863 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-61104287-cf10-4d7c-881b-65da89f0263e tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:56.948730 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-61104287-cf10-4d7c-881b-65da89f0263e tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1363 microversion: 2.1 time: 0.197690 Jun 30 10:40:56.949384 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 82/159] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:56 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1363 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:40:56.975148 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-4b71ddc4-ae21-4be7-ac88-2d52aa87140d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:56.975855 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-4b71ddc4-ae21-4be7-ac88-2d52aa87140d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:56.982520 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-4b71ddc4-ae21-4be7-ac88-2d52aa87140d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:56.982971 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-4b71ddc4-ae21-4be7-ac88-2d52aa87140d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:56.983761 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-4b71ddc4-ae21-4be7-ac88-2d52aa87140d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:56.984200 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-4b71ddc4-ae21-4be7-ac88-2d52aa87140d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:57.127261 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-1a4b1210-b5af-4ad2-9c08-9554ff7655d2 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:57.127870 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-1a4b1210-b5af-4ad2-9c08-9554ff7655d2 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] [instance: 5c8d5bc5-4671-4189-94e0-1442e872fc2d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:57.134215 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1a4b1210-b5af-4ad2-9c08-9554ff7655d2 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:57.134668 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1a4b1210-b5af-4ad2-9c08-9554ff7655d2 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:57.135443 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1a4b1210-b5af-4ad2-9c08-9554ff7655d2 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:57.135905 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1a4b1210-b5af-4ad2-9c08-9554ff7655d2 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:57.145693 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-4b71ddc4-ae21-4be7-ac88-2d52aa87140d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:57.154682 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-4b71ddc4-ae21-4be7-ac88-2d52aa87140d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:57.156860 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-4b71ddc4-ae21-4be7-ac88-2d52aa87140d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:57.158128 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-4b71ddc4-ae21-4be7-ac88-2d52aa87140d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1407 microversion: 2.20 time: 0.187176 Jun 30 10:40:57.160537 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 78/160] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:40:56 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1407 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:40:57.263031 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-1a4b1210-b5af-4ad2-9c08-9554ff7655d2 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad75a8b887a4a40accb49603f03c8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d27fbbe7475782fe2202e34aec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:57.270997 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-1a4b1210-b5af-4ad2-9c08-9554ff7655d2 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] 10.222.0.59 "GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d" status: 200 len: 1314 microversion: 2.1 time: 0.147635 Jun 30 10:40:57.271690 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 83/161] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:57 2022] GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:40:57.519635 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-7508a3fd-b4ed-4a38-be0e-06ae2cd1a1b5 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:57.520235 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-7508a3fd-b4ed-4a38-be0e-06ae2cd1a1b5 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:57.526144 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-7508a3fd-b4ed-4a38-be0e-06ae2cd1a1b5 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:57.526575 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-7508a3fd-b4ed-4a38-be0e-06ae2cd1a1b5 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:57.527313 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-7508a3fd-b4ed-4a38-be0e-06ae2cd1a1b5 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:57.527736 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-7508a3fd-b4ed-4a38-be0e-06ae2cd1a1b5 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:57.531526 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_cell1:SELECT=100 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:57.654261 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-7508a3fd-b4ed-4a38-be0e-06ae2cd1a1b5 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:57.661582 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-7508a3fd-b4ed-4a38-be0e-06ae2cd1a1b5 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1321 microversion: 2.1 time: 0.145748 Jun 30 10:40:57.662139 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 79/162] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:57 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1321 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:57.705740 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-040508b2-22bb-4c29-9918-071b039758b9 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:57.706344 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-040508b2-22bb-4c29-9918-071b039758b9 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 6bc2024c-c05e-4409-a142-e8cf3191a203] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:57.712336 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-040508b2-22bb-4c29-9918-071b039758b9 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:57.712807 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-040508b2-22bb-4c29-9918-071b039758b9 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:57.713557 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-040508b2-22bb-4c29-9918-071b039758b9 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:57.714013 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-040508b2-22bb-4c29-9918-071b039758b9 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:57.845657 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-040508b2-22bb-4c29-9918-071b039758b9 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:57.853844 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-040508b2-22bb-4c29-9918-071b039758b9 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203" status: 200 len: 1366 microversion: 2.1 time: 0.152436 Jun 30 10:40:57.854724 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 84/163] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:57 2022] GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:57.966719 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-914115eb-e6b8-497e-b5cb-41e49f19a6a2 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:57.967303 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-914115eb-e6b8-497e-b5cb-41e49f19a6a2 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:57.973691 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-914115eb-e6b8-497e-b5cb-41e49f19a6a2 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:57.974405 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-914115eb-e6b8-497e-b5cb-41e49f19a6a2 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:57.975362 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-914115eb-e6b8-497e-b5cb-41e49f19a6a2 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:57.975996 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-914115eb-e6b8-497e-b5cb-41e49f19a6a2 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:58.175048 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-914115eb-e6b8-497e-b5cb-41e49f19a6a2 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:58.177718 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-a19306f0-a960-4e88-910d-d7fb5ef3dbd4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:58.178491 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-a19306f0-a960-4e88-910d-d7fb5ef3dbd4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:58.185689 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a19306f0-a960-4e88-910d-d7fb5ef3dbd4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:58.186552 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a19306f0-a960-4e88-910d-d7fb5ef3dbd4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:58.187573 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a19306f0-a960-4e88-910d-d7fb5ef3dbd4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:58.188201 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a19306f0-a960-4e88-910d-d7fb5ef3dbd4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:58.188955 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-914115eb-e6b8-497e-b5cb-41e49f19a6a2 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1363 microversion: 2.1 time: 0.225836 Jun 30 10:40:58.198371 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 80/164] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:57 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1363 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:58.288749 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-81a0061c-e80c-4e62-a9f2-9ee922a3f1b9 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:58.290452 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-81a0061c-e80c-4e62-a9f2-9ee922a3f1b9 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] [instance: 5c8d5bc5-4671-4189-94e0-1442e872fc2d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:58.297907 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-81a0061c-e80c-4e62-a9f2-9ee922a3f1b9 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:58.298527 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-81a0061c-e80c-4e62-a9f2-9ee922a3f1b9 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:58.299624 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-81a0061c-e80c-4e62-a9f2-9ee922a3f1b9 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:58.300209 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-81a0061c-e80c-4e62-a9f2-9ee922a3f1b9 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:58.468826 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-a19306f0-a960-4e88-910d-d7fb5ef3dbd4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:58.486468 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-a19306f0-a960-4e88-910d-d7fb5ef3dbd4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:58.488900 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-a19306f0-a960-4e88-910d-d7fb5ef3dbd4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:58.490239 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-a19306f0-a960-4e88-910d-d7fb5ef3dbd4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1407 microversion: 2.20 time: 0.316643 Jun 30 10:40:58.501611 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 85/165] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:40:58 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1407 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:40:58.519698 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-81a0061c-e80c-4e62-a9f2-9ee922a3f1b9 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad75a8b887a4a40accb49603f03c8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d27fbbe7475782fe2202e34aec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:58.533774 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-81a0061c-e80c-4e62-a9f2-9ee922a3f1b9 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] 10.222.0.59 "GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d" status: 200 len: 1314 microversion: 2.1 time: 0.247356 Jun 30 10:40:58.534509 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 81/166] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:58 2022] GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:58.589596 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [req-c9c9286e-a433-4d35-a5a8-ae4160f00d21 req-e2b26158-9a60-407b-96d7-53d41a6dfbb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecd0d1a0-003c-4199-984a-80b41602909f", "name": "network-vif-plugged", "status": "completed", "tag": "8f7bc5c0-f904-466a-8e66-4bf59256553e"}]} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:40:58.599195 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-c9c9286e-a433-4d35-a5a8-ae4160f00d21 req-e2b26158-9a60-407b-96d7-53d41a6dfbb2 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:58.599863 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-c9c9286e-a433-4d35-a5a8-ae4160f00d21 req-e2b26158-9a60-407b-96d7-53d41a6dfbb2 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:58.615465 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.compute.server_external_events [req-c9c9286e-a433-4d35-a5a8-ae4160f00d21 req-e2b26158-9a60-407b-96d7-53d41a6dfbb2 service nova] Creating event network-vif-plugged:8f7bc5c0-f904-466a-8e66-4bf59256553e for instance ecd0d1a0-003c-4199-984a-80b41602909f on hv-cinder-82282 Jun 30 10:40:58.621101 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [req-c9c9286e-a433-4d35-a5a8-ae4160f00d21 req-e2b26158-9a60-407b-96d7-53d41a6dfbb2 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127675 Jun 30 10:40:58.622184 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 86/167] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:40:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:40:58.677905 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-b841b350-7b83-490e-85e7-7b5699c6fc6c tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:58.678616 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-b841b350-7b83-490e-85e7-7b5699c6fc6c tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:58.684665 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b841b350-7b83-490e-85e7-7b5699c6fc6c tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:58.685120 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b841b350-7b83-490e-85e7-7b5699c6fc6c tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:58.685874 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b841b350-7b83-490e-85e7-7b5699c6fc6c tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:58.686342 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b841b350-7b83-490e-85e7-7b5699c6fc6c tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:58.823610 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-b841b350-7b83-490e-85e7-7b5699c6fc6c tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:58.832333 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-b841b350-7b83-490e-85e7-7b5699c6fc6c tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1321 microversion: 2.1 time: 0.157855 Jun 30 10:40:58.832432 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 82/168] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:58 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:58.871562 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-99691f6c-7777-4540-a9c0-47a166357393 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:58.872342 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-99691f6c-7777-4540-a9c0-47a166357393 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 6bc2024c-c05e-4409-a142-e8cf3191a203] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:58.879433 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-99691f6c-7777-4540-a9c0-47a166357393 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:58.879964 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-99691f6c-7777-4540-a9c0-47a166357393 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:58.880819 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-99691f6c-7777-4540-a9c0-47a166357393 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:58.881319 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-99691f6c-7777-4540-a9c0-47a166357393 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:59.019757 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-99691f6c-7777-4540-a9c0-47a166357393 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:59.027349 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-99691f6c-7777-4540-a9c0-47a166357393 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203" status: 200 len: 1366 microversion: 2.1 time: 0.159998 Jun 30 10:40:59.027913 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 87/169] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:58 2022] GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:59.205139 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-27fda318-72fa-4652-84be-537b1fd87b1b tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:59.205852 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-27fda318-72fa-4652-84be-537b1fd87b1b tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:59.211720 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-27fda318-72fa-4652-84be-537b1fd87b1b tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:59.212166 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-27fda318-72fa-4652-84be-537b1fd87b1b tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:59.212956 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-27fda318-72fa-4652-84be-537b1fd87b1b tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:59.213392 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-27fda318-72fa-4652-84be-537b1fd87b1b tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:59.346340 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-27fda318-72fa-4652-84be-537b1fd87b1b tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:59.353786 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-27fda318-72fa-4652-84be-537b1fd87b1b tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1363 microversion: 2.1 time: 0.152955 Jun 30 10:40:59.354423 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 83/170] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:59 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:40:59.509380 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-f6a60ecf-8e78-40e6-bfc9-197a8d1251d4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:59.509973 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-f6a60ecf-8e78-40e6-bfc9-197a8d1251d4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:59.515987 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f6a60ecf-8e78-40e6-bfc9-197a8d1251d4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:59.516421 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f6a60ecf-8e78-40e6-bfc9-197a8d1251d4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:59.517190 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f6a60ecf-8e78-40e6-bfc9-197a8d1251d4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:59.517616 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f6a60ecf-8e78-40e6-bfc9-197a8d1251d4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:59.551535 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-bf1b746f-a823-4b8b-9790-ce3489bc543e tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:59.552139 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-bf1b746f-a823-4b8b-9790-ce3489bc543e tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] [instance: 5c8d5bc5-4671-4189-94e0-1442e872fc2d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:59.558288 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-bf1b746f-a823-4b8b-9790-ce3489bc543e tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:59.558732 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-bf1b746f-a823-4b8b-9790-ce3489bc543e tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:59.559492 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-bf1b746f-a823-4b8b-9790-ce3489bc543e tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:59.559924 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-bf1b746f-a823-4b8b-9790-ce3489bc543e tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:59.694988 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-f6a60ecf-8e78-40e6-bfc9-197a8d1251d4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:59.704077 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-f6a60ecf-8e78-40e6-bfc9-197a8d1251d4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:59.705900 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-f6a60ecf-8e78-40e6-bfc9-197a8d1251d4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:59.707308 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-f6a60ecf-8e78-40e6-bfc9-197a8d1251d4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1407 microversion: 2.20 time: 0.201888 Jun 30 10:40:59.708464 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 88/171] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:40:59 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1407 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:40:59.722364 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-bf1b746f-a823-4b8b-9790-ce3489bc543e tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad75a8b887a4a40accb49603f03c8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d27fbbe7475782fe2202e34aec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:40:59.730632 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-bf1b746f-a823-4b8b-9790-ce3489bc543e tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] 10.222.0.59 "GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d" status: 200 len: 1314 microversion: 2.1 time: 0.182855 Jun 30 10:40:59.731398 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 84/172] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:59 2022] GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:40:59.850568 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-800a1ad1-a5d8-4768-8f02-d5a244b00479 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:40:59.851289 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-800a1ad1-a5d8-4768-8f02-d5a244b00479 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:40:59.857929 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-800a1ad1-a5d8-4768-8f02-d5a244b00479 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:59.859261 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-800a1ad1-a5d8-4768-8f02-d5a244b00479 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:40:59.860769 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-800a1ad1-a5d8-4768-8f02-d5a244b00479 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:40:59.861312 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-800a1ad1-a5d8-4768-8f02-d5a244b00479 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:00.015790 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-800a1ad1-a5d8-4768-8f02-d5a244b00479 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:00.023241 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-800a1ad1-a5d8-4768-8f02-d5a244b00479 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1321 microversion: 2.1 time: 0.176637 Jun 30 10:41:00.024021 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 89/173] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:40:59 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1321 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:00.045495 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-0e77b754-5f26-4ff7-ae62-040621d2b803 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:00.046104 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-0e77b754-5f26-4ff7-ae62-040621d2b803 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 6bc2024c-c05e-4409-a142-e8cf3191a203] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:00.052970 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0e77b754-5f26-4ff7-ae62-040621d2b803 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:00.053540 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0e77b754-5f26-4ff7-ae62-040621d2b803 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:00.054434 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0e77b754-5f26-4ff7-ae62-040621d2b803 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:00.054942 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0e77b754-5f26-4ff7-ae62-040621d2b803 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:00.185619 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-0e77b754-5f26-4ff7-ae62-040621d2b803 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:00.193272 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-0e77b754-5f26-4ff7-ae62-040621d2b803 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203" status: 200 len: 1366 microversion: 2.1 time: 0.151579 Jun 30 10:41:00.193845 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 85/174] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:00 2022] GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:41:00.370845 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-88b775bb-eb3d-4427-9ea5-596170c31c8f tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:00.371456 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-88b775bb-eb3d-4427-9ea5-596170c31c8f tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:00.378033 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-88b775bb-eb3d-4427-9ea5-596170c31c8f tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:00.378474 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-88b775bb-eb3d-4427-9ea5-596170c31c8f tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:00.379222 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-88b775bb-eb3d-4427-9ea5-596170c31c8f tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:00.379654 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-88b775bb-eb3d-4427-9ea5-596170c31c8f tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:00.512688 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-88b775bb-eb3d-4427-9ea5-596170c31c8f tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:00.521336 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-88b775bb-eb3d-4427-9ea5-596170c31c8f tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1363 microversion: 2.1 time: 0.154196 Jun 30 10:41:00.521908 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 90/175] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:00 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:00.727420 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-67e05be8-dd14-4891-a04f-4ac871d87e4f tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:00.728025 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-67e05be8-dd14-4891-a04f-4ac871d87e4f tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:00.734433 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-67e05be8-dd14-4891-a04f-4ac871d87e4f tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:00.734883 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-67e05be8-dd14-4891-a04f-4ac871d87e4f tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:00.735642 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-67e05be8-dd14-4891-a04f-4ac871d87e4f tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:00.736074 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-67e05be8-dd14-4891-a04f-4ac871d87e4f tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:00.748522 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-6b9da673-6756-4db2-a80b-24d7a43bba78 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:00.749119 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-6b9da673-6756-4db2-a80b-24d7a43bba78 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] [instance: 5c8d5bc5-4671-4189-94e0-1442e872fc2d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:00.756887 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6b9da673-6756-4db2-a80b-24d7a43bba78 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:00.757334 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6b9da673-6756-4db2-a80b-24d7a43bba78 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:00.758495 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6b9da673-6756-4db2-a80b-24d7a43bba78 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:00.759055 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6b9da673-6756-4db2-a80b-24d7a43bba78 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:01.012375 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-67e05be8-dd14-4891-a04f-4ac871d87e4f tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:01.024663 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-6b9da673-6756-4db2-a80b-24d7a43bba78 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad75a8b887a4a40accb49603f03c8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d27fbbe7475782fe2202e34aec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:01.032042 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-67e05be8-dd14-4891-a04f-4ac871d87e4f tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:01.037185 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-6b9da673-6756-4db2-a80b-24d7a43bba78 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] 10.222.0.59 "GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d" status: 200 len: 1314 microversion: 2.1 time: 0.292633 Jun 30 10:41:01.038061 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 91/176] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:00 2022] GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:41:01.043836 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-1e40de5c-7afa-4b60-9827-b64c5e1e4b63 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:01.044447 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-1e40de5c-7afa-4b60-9827-b64c5e1e4b63 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:01.046070 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-67e05be8-dd14-4891-a04f-4ac871d87e4f tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:01.047623 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-67e05be8-dd14-4891-a04f-4ac871d87e4f tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1407 microversion: 2.20 time: 0.323936 Jun 30 10:41:01.048196 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 86/177] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:41:00 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1407 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:41:01.053592 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1e40de5c-7afa-4b60-9827-b64c5e1e4b63 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:01.054327 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1e40de5c-7afa-4b60-9827-b64c5e1e4b63 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:01.055290 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1e40de5c-7afa-4b60-9827-b64c5e1e4b63 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:01.055947 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1e40de5c-7afa-4b60-9827-b64c5e1e4b63 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:01.211969 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-24650487-7ad3-4c3a-a70b-d028b2018627 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:01.213960 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-24650487-7ad3-4c3a-a70b-d028b2018627 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 6bc2024c-c05e-4409-a142-e8cf3191a203] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:01.225756 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-1e40de5c-7afa-4b60-9827-b64c5e1e4b63 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:01.229398 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-24650487-7ad3-4c3a-a70b-d028b2018627 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:01.231400 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-24650487-7ad3-4c3a-a70b-d028b2018627 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:01.234687 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-24650487-7ad3-4c3a-a70b-d028b2018627 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:01.235435 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-24650487-7ad3-4c3a-a70b-d028b2018627 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:01.235696 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-1e40de5c-7afa-4b60-9827-b64c5e1e4b63 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1321 microversion: 2.1 time: 0.196388 Jun 30 10:41:01.236370 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 92/178] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:01 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1321 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:01.393451 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-24650487-7ad3-4c3a-a70b-d028b2018627 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:01.401369 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-24650487-7ad3-4c3a-a70b-d028b2018627 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203" status: 200 len: 1366 microversion: 2.1 time: 0.193213 Jun 30 10:41:01.401948 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 87/179] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:01 2022] GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203 => generated 1366 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:01.539524 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-45c0cb27-f749-4a0c-a2a2-e1c809b27459 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:01.543797 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-45c0cb27-f749-4a0c-a2a2-e1c809b27459 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:01.551441 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-45c0cb27-f749-4a0c-a2a2-e1c809b27459 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:01.552533 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-45c0cb27-f749-4a0c-a2a2-e1c809b27459 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:01.553453 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-45c0cb27-f749-4a0c-a2a2-e1c809b27459 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:01.554092 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-45c0cb27-f749-4a0c-a2a2-e1c809b27459 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:01.807166 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-45c0cb27-f749-4a0c-a2a2-e1c809b27459 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:01.861244 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-45c0cb27-f749-4a0c-a2a2-e1c809b27459 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1363 microversion: 2.1 time: 0.320714 Jun 30 10:41:01.872058 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 93/180] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:01 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1363 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:02.055880 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-68203cef-25d5-4c61-8b8c-11f3c6abccf7 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:02.056520 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-68203cef-25d5-4c61-8b8c-11f3c6abccf7 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] [instance: 5c8d5bc5-4671-4189-94e0-1442e872fc2d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:02.066481 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-f8c0414a-be15-45d3-be81-f13da23ed139 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:02.067747 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-f8c0414a-be15-45d3-be81-f13da23ed139 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:02.078949 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-68203cef-25d5-4c61-8b8c-11f3c6abccf7 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:02.079997 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-68203cef-25d5-4c61-8b8c-11f3c6abccf7 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:02.081471 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-68203cef-25d5-4c61-8b8c-11f3c6abccf7 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:02.082439 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f8c0414a-be15-45d3-be81-f13da23ed139 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:02.083134 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-68203cef-25d5-4c61-8b8c-11f3c6abccf7 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:02.083886 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f8c0414a-be15-45d3-be81-f13da23ed139 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:02.085696 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f8c0414a-be15-45d3-be81-f13da23ed139 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:02.088786 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f8c0414a-be15-45d3-be81-f13da23ed139 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:02.383414 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-68203cef-25d5-4c61-8b8c-11f3c6abccf7 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad75a8b887a4a40accb49603f03c8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d27fbbe7475782fe2202e34aec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:02.400782 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-f8c0414a-be15-45d3-be81-f13da23ed139 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:02.415076 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-68203cef-25d5-4c61-8b8c-11f3c6abccf7 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] 10.222.0.59 "GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d" status: 200 len: 1314 microversion: 2.1 time: 0.364358 Jun 30 10:41:02.418427 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-f8c0414a-be15-45d3-be81-f13da23ed139 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:02.429730 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 88/181] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:02 2022] GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d => generated 1314 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:02.431522 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-f8c0414a-be15-45d3-be81-f13da23ed139 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:02.437080 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-f8c0414a-be15-45d3-be81-f13da23ed139 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1407 microversion: 2.20 time: 0.375309 Jun 30 10:41:02.441331 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-f8dcd74f-ad1b-40eb-9561-943a5d69d888 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:02.441747 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 94/182] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:41:02 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1407 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:41:02.443752 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-f8dcd74f-ad1b-40eb-9561-943a5d69d888 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:02.454755 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [req-49c25059-d68c-4a6a-9970-ca1a34f39e29 req-e3ce1d2e-42f6-4560-a9e9-6fcbb97f5a7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "109c8a70-7b89-45b4-8876-a3286375b27d", "name": "network-vif-plugged", "status": "completed", "tag": "f447476f-b643-426d-ab27-775f942eaf6e"}]} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:41:02.457879 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-f8dcd74f-ad1b-40eb-9561-943a5d69d888 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:02.459209 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-f8dcd74f-ad1b-40eb-9561-943a5d69d888 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:02.461184 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-f8dcd74f-ad1b-40eb-9561-943a5d69d888 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:02.462700 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-f8dcd74f-ad1b-40eb-9561-943a5d69d888 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:02.477320 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-49c25059-d68c-4a6a-9970-ca1a34f39e29 req-e3ce1d2e-42f6-4560-a9e9-6fcbb97f5a7e service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:02.478175 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-49c25059-d68c-4a6a-9970-ca1a34f39e29 req-e3ce1d2e-42f6-4560-a9e9-6fcbb97f5a7e service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:02.498125 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_cell1:SELECT=100 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:41:02.523151 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.compute.server_external_events [req-49c25059-d68c-4a6a-9970-ca1a34f39e29 req-e3ce1d2e-42f6-4560-a9e9-6fcbb97f5a7e service nova] Creating event network-vif-plugged:f447476f-b643-426d-ab27-775f942eaf6e for instance 109c8a70-7b89-45b4-8876-a3286375b27d on hv-cinder-82282 Jun 30 10:41:02.531760 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [req-49c25059-d68c-4a6a-9970-ca1a34f39e29 req-e3ce1d2e-42f6-4560-a9e9-6fcbb97f5a7e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088718 Jun 30 10:41:02.533070 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 95/183] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:41:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:41:02.539506 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-84fc7eda-1181-49bd-a2c3-4c537a041e74 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:02.540365 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-84fc7eda-1181-49bd-a2c3-4c537a041e74 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 6bc2024c-c05e-4409-a142-e8cf3191a203] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:02.547448 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-84fc7eda-1181-49bd-a2c3-4c537a041e74 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:02.548190 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-84fc7eda-1181-49bd-a2c3-4c537a041e74 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:02.549231 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-84fc7eda-1181-49bd-a2c3-4c537a041e74 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:02.549892 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-84fc7eda-1181-49bd-a2c3-4c537a041e74 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:02.839027 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-84fc7eda-1181-49bd-a2c3-4c537a041e74 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:02.848970 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-84fc7eda-1181-49bd-a2c3-4c537a041e74 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203" status: 200 len: 1366 microversion: 2.1 time: 0.314037 Jun 30 10:41:02.849753 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 96/184] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:02 2022] GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203 => generated 1366 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:02.866898 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-f8dcd74f-ad1b-40eb-9561-943a5d69d888 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:02.890627 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-46c700c4-491b-4152-9d3b-e2d439df239b tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:02.891579 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-46c700c4-491b-4152-9d3b-e2d439df239b tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:02.895789 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-f8dcd74f-ad1b-40eb-9561-943a5d69d888 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1321 microversion: 2.1 time: 0.463056 Jun 30 10:41:02.896899 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 89/185] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:02 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1321 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:02.905876 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-46c700c4-491b-4152-9d3b-e2d439df239b tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:02.906515 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-46c700c4-491b-4152-9d3b-e2d439df239b tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:02.907437 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-46c700c4-491b-4152-9d3b-e2d439df239b tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:02.908060 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-46c700c4-491b-4152-9d3b-e2d439df239b tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:03.085247 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-46c700c4-491b-4152-9d3b-e2d439df239b tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:03.099419 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-46c700c4-491b-4152-9d3b-e2d439df239b tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1363 microversion: 2.1 time: 0.214661 Jun 30 10:41:03.101144 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 97/186] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:02 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1363 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:03.436081 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-701cd0dd-d1f8-4f72-a0a2-025ef44353f1 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:03.437512 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-701cd0dd-d1f8-4f72-a0a2-025ef44353f1 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] [instance: 5c8d5bc5-4671-4189-94e0-1442e872fc2d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:03.444037 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-701cd0dd-d1f8-4f72-a0a2-025ef44353f1 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:03.444477 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-701cd0dd-d1f8-4f72-a0a2-025ef44353f1 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:03.445536 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-701cd0dd-d1f8-4f72-a0a2-025ef44353f1 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:03.446112 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-701cd0dd-d1f8-4f72-a0a2-025ef44353f1 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:03.457407 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-21c83429-14f7-4b86-ac7b-36cec370a49b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:03.458157 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-21c83429-14f7-4b86-ac7b-36cec370a49b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:03.479098 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-21c83429-14f7-4b86-ac7b-36cec370a49b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:03.479693 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-21c83429-14f7-4b86-ac7b-36cec370a49b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:03.480874 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-21c83429-14f7-4b86-ac7b-36cec370a49b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:03.481553 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-21c83429-14f7-4b86-ac7b-36cec370a49b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:03.909574 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-701cd0dd-d1f8-4f72-a0a2-025ef44353f1 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad75a8b887a4a40accb49603f03c8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d27fbbe7475782fe2202e34aec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:03.920516 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-21c83429-14f7-4b86-ac7b-36cec370a49b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:03.930312 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-701cd0dd-d1f8-4f72-a0a2-025ef44353f1 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] 10.222.0.59 "GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d" status: 200 len: 1314 microversion: 2.1 time: 0.498921 Jun 30 10:41:03.932265 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 90/187] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:03 2022] GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d => generated 1314 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:03.945094 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-007c6842-5c22-4e31-8e58-709b83116c16 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:03.945283 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-21c83429-14f7-4b86-ac7b-36cec370a49b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:03.945742 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-007c6842-5c22-4e31-8e58-709b83116c16 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 6bc2024c-c05e-4409-a142-e8cf3191a203] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:03.949558 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-21c83429-14f7-4b86-ac7b-36cec370a49b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:03.950767 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-21c83429-14f7-4b86-ac7b-36cec370a49b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1407 microversion: 2.20 time: 0.497328 Jun 30 10:41:03.953643 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 98/188] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:41:03 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1407 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 10:41:03.960899 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-623a986d-5cc0-44a6-b791-7fc2ee00567b tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:03.961741 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-623a986d-5cc0-44a6-b791-7fc2ee00567b tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:03.966706 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-007c6842-5c22-4e31-8e58-709b83116c16 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:03.967144 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-007c6842-5c22-4e31-8e58-709b83116c16 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:03.968405 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-007c6842-5c22-4e31-8e58-709b83116c16 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:03.969077 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-007c6842-5c22-4e31-8e58-709b83116c16 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:03.970103 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-623a986d-5cc0-44a6-b791-7fc2ee00567b tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:03.970637 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-623a986d-5cc0-44a6-b791-7fc2ee00567b tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:03.971414 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-623a986d-5cc0-44a6-b791-7fc2ee00567b tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:03.971851 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-623a986d-5cc0-44a6-b791-7fc2ee00567b tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:04.270855 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-007c6842-5c22-4e31-8e58-709b83116c16 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:04.282225 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-007c6842-5c22-4e31-8e58-709b83116c16 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203" status: 200 len: 1366 microversion: 2.1 time: 0.347639 Jun 30 10:41:04.284951 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 91/189] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:03 2022] GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203 => generated 1366 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:04.301246 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-623a986d-5cc0-44a6-b791-7fc2ee00567b tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:04.302177 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-734ba427-0972-4f95-a890-c52958cf5f48 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:04.302887 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-734ba427-0972-4f95-a890-c52958cf5f48 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:04.311271 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-623a986d-5cc0-44a6-b791-7fc2ee00567b tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1321 microversion: 2.1 time: 0.355657 Jun 30 10:41:04.314364 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 99/190] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:03 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1321 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:04.322463 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-734ba427-0972-4f95-a890-c52958cf5f48 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:04.322927 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-734ba427-0972-4f95-a890-c52958cf5f48 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:04.323773 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-734ba427-0972-4f95-a890-c52958cf5f48 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:04.324197 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-734ba427-0972-4f95-a890-c52958cf5f48 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:04.485256 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-734ba427-0972-4f95-a890-c52958cf5f48 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:04.493098 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-734ba427-0972-4f95-a890-c52958cf5f48 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1363 microversion: 2.1 time: 0.207297 Jun 30 10:41:04.493804 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 92/191] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:04 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1363 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:04.549013 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [req-5549d2ff-e901-4d1d-9bf8-76df3e98f094 req-58f186dc-0501-4bde-bad9-9bc411d29127 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c8d5bc5-4671-4189-94e0-1442e872fc2d", "name": "network-vif-plugged", "status": "completed", "tag": "6f18de23-489e-4e05-88b1-28c018e4e789"}]} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:41:04.558482 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-5549d2ff-e901-4d1d-9bf8-76df3e98f094 req-58f186dc-0501-4bde-bad9-9bc411d29127 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:04.558917 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-5549d2ff-e901-4d1d-9bf8-76df3e98f094 req-58f186dc-0501-4bde-bad9-9bc411d29127 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:04.572816 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.compute.server_external_events [req-5549d2ff-e901-4d1d-9bf8-76df3e98f094 req-58f186dc-0501-4bde-bad9-9bc411d29127 service nova] Creating event network-vif-plugged:6f18de23-489e-4e05-88b1-28c018e4e789 for instance 5c8d5bc5-4671-4189-94e0-1442e872fc2d on hv-cinder-82282 Jun 30 10:41:04.579883 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [req-5549d2ff-e901-4d1d-9bf8-76df3e98f094 req-58f186dc-0501-4bde-bad9-9bc411d29127 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034736 Jun 30 10:41:04.580364 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 100/192] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:41:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 10:41:04.949885 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-c2400c95-9de6-4f5c-a400-eb2a48246223 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:04.950596 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-c2400c95-9de6-4f5c-a400-eb2a48246223 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] [instance: 5c8d5bc5-4671-4189-94e0-1442e872fc2d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:04.957499 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c2400c95-9de6-4f5c-a400-eb2a48246223 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:04.957940 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c2400c95-9de6-4f5c-a400-eb2a48246223 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:04.958698 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c2400c95-9de6-4f5c-a400-eb2a48246223 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:04.959126 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c2400c95-9de6-4f5c-a400-eb2a48246223 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:04.977587 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-309dc43d-a648-4a73-aa07-2faef342295d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:04.978511 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-309dc43d-a648-4a73-aa07-2faef342295d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:04.988443 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-309dc43d-a648-4a73-aa07-2faef342295d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:04.990330 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-309dc43d-a648-4a73-aa07-2faef342295d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:04.991312 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-309dc43d-a648-4a73-aa07-2faef342295d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:04.991904 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-309dc43d-a648-4a73-aa07-2faef342295d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:05.248196 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-c2400c95-9de6-4f5c-a400-eb2a48246223 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad75a8b887a4a40accb49603f03c8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d27fbbe7475782fe2202e34aec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:05.250919 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-309dc43d-a648-4a73-aa07-2faef342295d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:05.263591 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-c2400c95-9de6-4f5c-a400-eb2a48246223 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] 10.222.0.59 "GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d" status: 200 len: 1314 microversion: 2.1 time: 0.317961 Jun 30 10:41:05.264604 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 93/193] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:04 2022] GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d => generated 1314 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:05.275374 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-309dc43d-a648-4a73-aa07-2faef342295d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:05.276912 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-309dc43d-a648-4a73-aa07-2faef342295d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:05.278125 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-309dc43d-a648-4a73-aa07-2faef342295d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1407 microversion: 2.20 time: 0.306659 Jun 30 10:41:05.278679 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 101/194] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:41:04 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1407 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 10:41:05.301913 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-879de23f-a3f7-4d6a-a13d-79f6ef68224a tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:05.302687 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-879de23f-a3f7-4d6a-a13d-79f6ef68224a tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 6bc2024c-c05e-4409-a142-e8cf3191a203] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:05.309855 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-879de23f-a3f7-4d6a-a13d-79f6ef68224a tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:05.310503 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-879de23f-a3f7-4d6a-a13d-79f6ef68224a tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:05.311982 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-879de23f-a3f7-4d6a-a13d-79f6ef68224a tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:05.312420 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-879de23f-a3f7-4d6a-a13d-79f6ef68224a tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:05.328490 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-dd7f65ac-49f8-4c19-a7d3-63890e1cb9a5 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:05.329283 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-dd7f65ac-49f8-4c19-a7d3-63890e1cb9a5 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:05.338228 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-dd7f65ac-49f8-4c19-a7d3-63890e1cb9a5 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:05.339230 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-dd7f65ac-49f8-4c19-a7d3-63890e1cb9a5 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:05.340280 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-dd7f65ac-49f8-4c19-a7d3-63890e1cb9a5 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:05.341051 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-dd7f65ac-49f8-4c19-a7d3-63890e1cb9a5 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:05.535051 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-879de23f-a3f7-4d6a-a13d-79f6ef68224a tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:05.545284 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-879de23f-a3f7-4d6a-a13d-79f6ef68224a tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203" status: 200 len: 1366 microversion: 2.1 time: 0.247338 Jun 30 10:41:05.546332 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 94/195] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:05 2022] GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203 => generated 1366 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:05.565925 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-a5180e3a-b969-4412-849b-175d98c86a68 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:05.566587 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-a5180e3a-b969-4412-849b-175d98c86a68 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:05.573917 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a5180e3a-b969-4412-849b-175d98c86a68 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:05.574708 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a5180e3a-b969-4412-849b-175d98c86a68 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:05.575627 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a5180e3a-b969-4412-849b-175d98c86a68 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:05.576350 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a5180e3a-b969-4412-849b-175d98c86a68 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:05.584072 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-dd7f65ac-49f8-4c19-a7d3-63890e1cb9a5 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:05.605242 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-dd7f65ac-49f8-4c19-a7d3-63890e1cb9a5 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1321 microversion: 2.1 time: 0.281218 Jun 30 10:41:05.607348 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 102/196] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:05 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1321 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:41:05.722017 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-a5180e3a-b969-4412-849b-175d98c86a68 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:05.725449 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_cell1:SELECT=100 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:41:05.730550 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-a5180e3a-b969-4412-849b-175d98c86a68 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1363 microversion: 2.1 time: 0.183003 Jun 30 10:41:05.731121 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 95/197] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:05 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1363 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:06.280686 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-35ee6848-dae5-484e-aa03-3620117a9fbc tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:06.281547 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-35ee6848-dae5-484e-aa03-3620117a9fbc tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] [instance: 5c8d5bc5-4671-4189-94e0-1442e872fc2d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:06.288254 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-35ee6848-dae5-484e-aa03-3620117a9fbc tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:06.288910 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-35ee6848-dae5-484e-aa03-3620117a9fbc tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:06.289843 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-35ee6848-dae5-484e-aa03-3620117a9fbc tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:06.290434 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-35ee6848-dae5-484e-aa03-3620117a9fbc tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:06.292666 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-fceea90b-3b02-478e-8b2c-57db10cb9bd7 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-764587909", "imageRef": "c473bd04-5a45-4eb7-b6f4-2b5033d4fc1d", "flavorRef": "452", "networks": [{"uuid": "6a2aa940-442e-40ee-bf15-ffb569bc03f6"}]}} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:41:06.353545 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.network.neutron [None req-fceea90b-3b02-478e-8b2c-57db10cb9bd7 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] validate_networks() for [('6a2aa940-442e-40ee-bf15-ffb569bc03f6', None, None, None, None, None)] {{(pid=124203) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 10:41:06.527499 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-35ee6848-dae5-484e-aa03-3620117a9fbc tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad75a8b887a4a40accb49603f03c8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d27fbbe7475782fe2202e34aec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:06.538146 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-35ee6848-dae5-484e-aa03-3620117a9fbc tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] 10.222.0.59 "GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d" status: 200 len: 1314 microversion: 2.1 time: 0.261968 Jun 30 10:41:06.542181 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 103/198] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:06 2022] GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:06.546933 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-f013bef4-6ae8-4db4-8bd8-ef6987542f6a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:06.549554 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-f013bef4-6ae8-4db4-8bd8-ef6987542f6a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:06.555666 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f013bef4-6ae8-4db4-8bd8-ef6987542f6a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:06.556150 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f013bef4-6ae8-4db4-8bd8-ef6987542f6a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:06.557167 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f013bef4-6ae8-4db4-8bd8-ef6987542f6a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:06.557690 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f013bef4-6ae8-4db4-8bd8-ef6987542f6a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:06.800180 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-f013bef4-6ae8-4db4-8bd8-ef6987542f6a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:06.815755 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-f013bef4-6ae8-4db4-8bd8-ef6987542f6a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:06.820644 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-f013bef4-6ae8-4db4-8bd8-ef6987542f6a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:06.821812 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-f013bef4-6ae8-4db4-8bd8-ef6987542f6a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1407 microversion: 2.20 time: 0.278592 Jun 30 10:41:06.822366 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 104/199] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:41:06 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1407 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:41:06.829073 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-c07a983d-404a-4aef-80fb-d0bc5a3ff1c3 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:06.829686 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-c07a983d-404a-4aef-80fb-d0bc5a3ff1c3 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 6bc2024c-c05e-4409-a142-e8cf3191a203] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:06.837116 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c07a983d-404a-4aef-80fb-d0bc5a3ff1c3 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:06.837639 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c07a983d-404a-4aef-80fb-d0bc5a3ff1c3 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:06.838473 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c07a983d-404a-4aef-80fb-d0bc5a3ff1c3 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:06.838977 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c07a983d-404a-4aef-80fb-d0bc5a3ff1c3 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:06.951957 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.virt.hardware [None req-fceea90b-3b02-478e-8b2c-57db10cb9bd7 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Flavor limits 0:0:0 {{(pid=124203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 10:41:06.953020 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.virt.hardware [None req-fceea90b-3b02-478e-8b2c-57db10cb9bd7 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Image limits 0:0:0 {{(pid=124203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 10:41:06.953840 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.virt.hardware [None req-fceea90b-3b02-478e-8b2c-57db10cb9bd7 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Flavor pref 0:0:0 {{(pid=124203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 10:41:06.954172 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.virt.hardware [None req-fceea90b-3b02-478e-8b2c-57db10cb9bd7 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Image pref 0:0:0 {{(pid=124203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 10:41:06.954714 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.virt.hardware [None req-fceea90b-3b02-478e-8b2c-57db10cb9bd7 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 10:41:06.977574 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-fceea90b-3b02-478e-8b2c-57db10cb9bd7 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:06.978458 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-fceea90b-3b02-478e-8b2c-57db10cb9bd7 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:06.984524 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-fceea90b-3b02-478e-8b2c-57db10cb9bd7 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:06.985201 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-fceea90b-3b02-478e-8b2c-57db10cb9bd7 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:07.063497 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.quota [None req-fceea90b-3b02-478e-8b2c-57db10cb9bd7 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Getting quotas for project d60ed6f6064a4cd88a03cf97ab7abeae. Resources: {'instances', 'cores', 'ram'} {{(pid=124203) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 10:41:07.073119 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-c07a983d-404a-4aef-80fb-d0bc5a3ff1c3 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:07.085925 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.quota [None req-fceea90b-3b02-478e-8b2c-57db10cb9bd7 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Getting quotas for user f5c0ccbf16fe4a399945aa5ad34754b5 and project d60ed6f6064a4cd88a03cf97ab7abeae. Resources: {'instances', 'cores', 'ram'} {{(pid=124203) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 10:41:07.086181 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-c07a983d-404a-4aef-80fb-d0bc5a3ff1c3 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203" status: 200 len: 1366 microversion: 2.1 time: 0.262517 Jun 30 10:41:07.088487 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 105/200] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:06 2022] GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203 => generated 1366 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:07.100705 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-989fbcff-52fb-4cef-8371-d392a9144873 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:07.101479 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-989fbcff-52fb-4cef-8371-d392a9144873 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:07.111136 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-989fbcff-52fb-4cef-8371-d392a9144873 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:07.111577 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-989fbcff-52fb-4cef-8371-d392a9144873 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:07.112618 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-989fbcff-52fb-4cef-8371-d392a9144873 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:07.113280 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-989fbcff-52fb-4cef-8371-d392a9144873 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:07.139661 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-fceea90b-3b02-478e-8b2c-57db10cb9bd7 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Going to run 1 instances... {{(pid=124203) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 10:41:07.144170 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-fceea90b-3b02-478e-8b2c-57db10cb9bd7 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] [instance: 68b71cd8-d4e6-4646-acf7-317020683d8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c473bd04-5a45-4eb7-b6f4-2b5033d4fc1d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124203) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 10:41:07.225904 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-fceea90b-3b02-478e-8b2c-57db10cb9bd7 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.938192 Jun 30 10:41:07.230316 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 96/201] 10.222.0.59 () {60 vars in 1146 bytes} [Thu Jun 30 10:41:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 942 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 30 10:41:07.245229 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-a839edb3-50fc-4858-8138-7cce3255c674 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:07.246014 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-a839edb3-50fc-4858-8138-7cce3255c674 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:07.260939 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a839edb3-50fc-4858-8138-7cce3255c674 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:07.262120 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a839edb3-50fc-4858-8138-7cce3255c674 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:07.263294 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a839edb3-50fc-4858-8138-7cce3255c674 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:07.264954 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a839edb3-50fc-4858-8138-7cce3255c674 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:07.275509 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-989fbcff-52fb-4cef-8371-d392a9144873 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:07.285333 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-989fbcff-52fb-4cef-8371-d392a9144873 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1321 microversion: 2.1 time: 0.195774 Jun 30 10:41:07.285904 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 106/202] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:07 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1321 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:07.291075 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-060e8c0e-d079-4bf7-acb4-e73eecc7b484 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:07.291894 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-060e8c0e-d079-4bf7-acb4-e73eecc7b484 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] [instance: 68b71cd8-d4e6-4646-acf7-317020683d8c] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:07.352976 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-060e8c0e-d079-4bf7-acb4-e73eecc7b484 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c0ccbf16fe4a399945aa5ad34754b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ed6f6064a4cd88a03cf97ab7abeae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:07.375422 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-060e8c0e-d079-4bf7-acb4-e73eecc7b484 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] 10.222.0.59 "GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c" status: 200 len: 1213 microversion: 2.1 time: 0.088219 Jun 30 10:41:07.381392 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 107/203] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:07 2022] GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c => generated 1213 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:07.511340 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-a839edb3-50fc-4858-8138-7cce3255c674 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:07.520240 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-a839edb3-50fc-4858-8138-7cce3255c674 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1363 microversion: 2.1 time: 0.284957 Jun 30 10:41:07.521027 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 97/204] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:07 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1363 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:07.555645 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-50ee70aa-9093-4b12-be13-05fe86cfa453 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:07.556255 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-50ee70aa-9093-4b12-be13-05fe86cfa453 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] [instance: 5c8d5bc5-4671-4189-94e0-1442e872fc2d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:07.562772 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-50ee70aa-9093-4b12-be13-05fe86cfa453 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:07.563245 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-50ee70aa-9093-4b12-be13-05fe86cfa453 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:07.564014 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-50ee70aa-9093-4b12-be13-05fe86cfa453 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:07.564444 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-50ee70aa-9093-4b12-be13-05fe86cfa453 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:07.719265 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-50ee70aa-9093-4b12-be13-05fe86cfa453 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad75a8b887a4a40accb49603f03c8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d27fbbe7475782fe2202e34aec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:07.726748 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-50ee70aa-9093-4b12-be13-05fe86cfa453 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] 10.222.0.59 "GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d" status: 200 len: 1314 microversion: 2.1 time: 0.174855 Jun 30 10:41:07.727304 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 108/205] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:07 2022] GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:07.839740 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-6f82b3d7-e90d-45b3-b011-4eaeaeb2024d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:07.840347 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-6f82b3d7-e90d-45b3-b011-4eaeaeb2024d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:07.846409 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-6f82b3d7-e90d-45b3-b011-4eaeaeb2024d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:07.846856 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-6f82b3d7-e90d-45b3-b011-4eaeaeb2024d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:07.847618 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-6f82b3d7-e90d-45b3-b011-4eaeaeb2024d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:07.848053 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-6f82b3d7-e90d-45b3-b011-4eaeaeb2024d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:07.985967 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-6f82b3d7-e90d-45b3-b011-4eaeaeb2024d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:07.995681 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-6f82b3d7-e90d-45b3-b011-4eaeaeb2024d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:07.998052 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-6f82b3d7-e90d-45b3-b011-4eaeaeb2024d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:08.000094 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-6f82b3d7-e90d-45b3-b011-4eaeaeb2024d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1407 microversion: 2.20 time: 0.164278 Jun 30 10:41:08.000831 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 98/206] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:41:07 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:41:08.109118 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-a42e2905-76c8-4de4-b152-68aea612fb41 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:08.109987 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-a42e2905-76c8-4de4-b152-68aea612fb41 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 6bc2024c-c05e-4409-a142-e8cf3191a203] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:08.116394 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a42e2905-76c8-4de4-b152-68aea612fb41 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:08.116851 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a42e2905-76c8-4de4-b152-68aea612fb41 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:08.122054 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a42e2905-76c8-4de4-b152-68aea612fb41 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:08.122688 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a42e2905-76c8-4de4-b152-68aea612fb41 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:08.176084 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [req-300ab939-93ca-454a-9dcc-acec8d87967d req-cc2dff9d-340d-4816-a066-0f8750d3f7ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af0d59b6-8e95-4947-803a-c1d952e218c8", "name": "network-vif-plugged", "status": "completed", "tag": "ec009e37-3070-46e8-8a9a-513065a2c654"}]} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:41:08.185358 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-300ab939-93ca-454a-9dcc-acec8d87967d req-cc2dff9d-340d-4816-a066-0f8750d3f7ab service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:08.185802 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-300ab939-93ca-454a-9dcc-acec8d87967d req-cc2dff9d-340d-4816-a066-0f8750d3f7ab service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:08.200975 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.compute.server_external_events [req-300ab939-93ca-454a-9dcc-acec8d87967d req-cc2dff9d-340d-4816-a066-0f8750d3f7ab service nova] Creating event network-vif-plugged:ec009e37-3070-46e8-8a9a-513065a2c654 for instance af0d59b6-8e95-4947-803a-c1d952e218c8 on hv-cinder-82282 Jun 30 10:41:08.207002 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [req-300ab939-93ca-454a-9dcc-acec8d87967d req-cc2dff9d-340d-4816-a066-0f8750d3f7ab service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034760 Jun 30 10:41:08.208154 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 99/207] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:41:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 10:41:08.288840 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-a42e2905-76c8-4de4-b152-68aea612fb41 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:08.297598 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-a42e2905-76c8-4de4-b152-68aea612fb41 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203" status: 200 len: 1366 microversion: 2.1 time: 0.192618 Jun 30 10:41:08.298170 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 109/208] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:08 2022] GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203 => generated 1366 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:08.303498 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-e3a3dc20-b547-4e0a-99e3-f3d5e86703ba tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:08.304184 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-e3a3dc20-b547-4e0a-99e3-f3d5e86703ba tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:08.310482 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e3a3dc20-b547-4e0a-99e3-f3d5e86703ba tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:08.310921 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e3a3dc20-b547-4e0a-99e3-f3d5e86703ba tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:08.312325 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e3a3dc20-b547-4e0a-99e3-f3d5e86703ba tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:08.312775 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e3a3dc20-b547-4e0a-99e3-f3d5e86703ba tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:08.399075 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-1e1e0c92-1b35-4b41-a2bd-8dfec231fd0f tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:08.399911 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-1e1e0c92-1b35-4b41-a2bd-8dfec231fd0f tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] [instance: 68b71cd8-d4e6-4646-acf7-317020683d8c] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:08.406656 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1e1e0c92-1b35-4b41-a2bd-8dfec231fd0f tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:08.407359 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1e1e0c92-1b35-4b41-a2bd-8dfec231fd0f tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:08.408387 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1e1e0c92-1b35-4b41-a2bd-8dfec231fd0f tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:08.409053 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1e1e0c92-1b35-4b41-a2bd-8dfec231fd0f tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:08.463804 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-e3a3dc20-b547-4e0a-99e3-f3d5e86703ba tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:08.473944 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-e3a3dc20-b547-4e0a-99e3-f3d5e86703ba tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1321 microversion: 2.1 time: 0.175845 Jun 30 10:41:08.475658 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 100/209] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:08 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1321 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:41:08.481032 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-1e1e0c92-1b35-4b41-a2bd-8dfec231fd0f tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c0ccbf16fe4a399945aa5ad34754b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ed6f6064a4cd88a03cf97ab7abeae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:08.490071 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-1e1e0c92-1b35-4b41-a2bd-8dfec231fd0f tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] 10.222.0.59 "GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c" status: 200 len: 1217 microversion: 2.1 time: 0.095538 Jun 30 10:41:08.490840 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 110/210] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:08 2022] GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c => generated 1217 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:41:08.539493 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-ba8effe5-1e9d-458b-b84a-6f1dd80c9d32 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:08.540393 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-ba8effe5-1e9d-458b-b84a-6f1dd80c9d32 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:08.547527 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ba8effe5-1e9d-458b-b84a-6f1dd80c9d32 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:08.547994 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ba8effe5-1e9d-458b-b84a-6f1dd80c9d32 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:08.548748 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ba8effe5-1e9d-458b-b84a-6f1dd80c9d32 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:08.549177 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ba8effe5-1e9d-458b-b84a-6f1dd80c9d32 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:08.698404 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-ba8effe5-1e9d-458b-b84a-6f1dd80c9d32 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:08.706964 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-ba8effe5-1e9d-458b-b84a-6f1dd80c9d32 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1363 microversion: 2.1 time: 0.172887 Jun 30 10:41:08.707622 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 101/211] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:08 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:08.743945 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-14c4924b-ccf2-4883-b938-b46fb9c5c6e6 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:08.744749 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-14c4924b-ccf2-4883-b938-b46fb9c5c6e6 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] [instance: 5c8d5bc5-4671-4189-94e0-1442e872fc2d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:08.751066 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-14c4924b-ccf2-4883-b938-b46fb9c5c6e6 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:08.751613 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-14c4924b-ccf2-4883-b938-b46fb9c5c6e6 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:08.752901 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-14c4924b-ccf2-4883-b938-b46fb9c5c6e6 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:08.753333 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-14c4924b-ccf2-4883-b938-b46fb9c5c6e6 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:09.019000 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-b8a68f85-0c2d-4880-b345-840a629d1b01 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:09.019635 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-b8a68f85-0c2d-4880-b345-840a629d1b01 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:09.021325 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-14c4924b-ccf2-4883-b938-b46fb9c5c6e6 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad75a8b887a4a40accb49603f03c8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d27fbbe7475782fe2202e34aec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:09.026409 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b8a68f85-0c2d-4880-b345-840a629d1b01 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:09.026856 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b8a68f85-0c2d-4880-b345-840a629d1b01 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:09.027623 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b8a68f85-0c2d-4880-b345-840a629d1b01 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:09.028052 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b8a68f85-0c2d-4880-b345-840a629d1b01 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:09.031337 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-14c4924b-ccf2-4883-b938-b46fb9c5c6e6 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] 10.222.0.59 "GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d" status: 200 len: 1314 microversion: 2.1 time: 0.291900 Jun 30 10:41:09.032618 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 111/212] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:08 2022] GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:09.315013 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-1694bfac-1258-41d7-b845-ee85daa7ba1b tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:09.315657 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-1694bfac-1258-41d7-b845-ee85daa7ba1b tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 6bc2024c-c05e-4409-a142-e8cf3191a203] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:09.321789 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1694bfac-1258-41d7-b845-ee85daa7ba1b tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:09.322236 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1694bfac-1258-41d7-b845-ee85daa7ba1b tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:09.322992 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1694bfac-1258-41d7-b845-ee85daa7ba1b tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:09.323427 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1694bfac-1258-41d7-b845-ee85daa7ba1b tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:09.911981 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-b8a68f85-0c2d-4880-b345-840a629d1b01 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:09.922826 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-b8a68f85-0c2d-4880-b345-840a629d1b01 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:09.924657 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-b8a68f85-0c2d-4880-b345-840a629d1b01 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:09.926121 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-b8a68f85-0c2d-4880-b345-840a629d1b01 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1407 microversion: 2.20 time: 0.911662 Jun 30 10:41:09.927762 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 102/213] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:41:09 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1407 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 10:41:09.934345 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-63546af4-53bc-42dd-bb59-43dcd2001d16 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:09.935304 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-63546af4-53bc-42dd-bb59-43dcd2001d16 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:09.945287 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-63546af4-53bc-42dd-bb59-43dcd2001d16 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:09.946355 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-63546af4-53bc-42dd-bb59-43dcd2001d16 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:09.949028 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-63546af4-53bc-42dd-bb59-43dcd2001d16 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:09.950736 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-63546af4-53bc-42dd-bb59-43dcd2001d16 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:09.981857 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-1694bfac-1258-41d7-b845-ee85daa7ba1b tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:09.990647 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-1694bfac-1258-41d7-b845-ee85daa7ba1b tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203" status: 200 len: 1366 microversion: 2.1 time: 0.679463 Jun 30 10:41:10.000189 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 112/214] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:09 2022] GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203 => generated 1366 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:41:10.004967 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-5452e4ad-8a31-48ea-80cf-f32cada458c7 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:10.005559 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-5452e4ad-8a31-48ea-80cf-f32cada458c7 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] [instance: 68b71cd8-d4e6-4646-acf7-317020683d8c] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:10.012072 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5452e4ad-8a31-48ea-80cf-f32cada458c7 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:10.012802 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5452e4ad-8a31-48ea-80cf-f32cada458c7 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:10.017091 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5452e4ad-8a31-48ea-80cf-f32cada458c7 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:10.017724 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5452e4ad-8a31-48ea-80cf-f32cada458c7 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:10.152496 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-5452e4ad-8a31-48ea-80cf-f32cada458c7 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c0ccbf16fe4a399945aa5ad34754b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ed6f6064a4cd88a03cf97ab7abeae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:10.171369 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-5452e4ad-8a31-48ea-80cf-f32cada458c7 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] 10.222.0.59 "GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c" status: 200 len: 1209 microversion: 2.1 time: 0.169464 Jun 30 10:41:10.171961 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 113/215] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:10 2022] GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c => generated 1209 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:10.187600 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-2ae39a47-aa5b-481e-9dba-b6867fc77bc0 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:10.188717 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-2ae39a47-aa5b-481e-9dba-b6867fc77bc0 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:10.200946 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-2ae39a47-aa5b-481e-9dba-b6867fc77bc0 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:10.201742 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-2ae39a47-aa5b-481e-9dba-b6867fc77bc0 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:10.202813 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-2ae39a47-aa5b-481e-9dba-b6867fc77bc0 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:10.203459 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-2ae39a47-aa5b-481e-9dba-b6867fc77bc0 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:10.210793 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_cell1:SELECT=100 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:41:10.466137 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-63546af4-53bc-42dd-bb59-43dcd2001d16 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:10.495308 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-63546af4-53bc-42dd-bb59-43dcd2001d16 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1321 microversion: 2.1 time: 0.565798 Jun 30 10:41:10.496450 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 103/216] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:09 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1321 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:10.501778 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-2ae39a47-aa5b-481e-9dba-b6867fc77bc0 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:10.504957 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-70697ec2-52f5-4767-b1a0-37fb864e1e6a tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:10.508109 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-70697ec2-52f5-4767-b1a0-37fb864e1e6a tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] [instance: 5c8d5bc5-4671-4189-94e0-1442e872fc2d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:10.522708 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-70697ec2-52f5-4767-b1a0-37fb864e1e6a tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:10.524774 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-2ae39a47-aa5b-481e-9dba-b6867fc77bc0 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1363 microversion: 2.1 time: 0.345977 Jun 30 10:41:10.525085 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-70697ec2-52f5-4767-b1a0-37fb864e1e6a tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:10.525902 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-70697ec2-52f5-4767-b1a0-37fb864e1e6a tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:10.526397 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-70697ec2-52f5-4767-b1a0-37fb864e1e6a tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:10.537396 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 114/217] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:10 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1363 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:10.809427 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-70697ec2-52f5-4767-b1a0-37fb864e1e6a tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad75a8b887a4a40accb49603f03c8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d27fbbe7475782fe2202e34aec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:10.822418 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-70697ec2-52f5-4767-b1a0-37fb864e1e6a tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] 10.222.0.59 "GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d" status: 200 len: 1314 microversion: 2.1 time: 0.324035 Jun 30 10:41:10.831950 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 104/218] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:10 2022] GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d => generated 1314 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:10.946874 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-421a95cc-a5e7-4257-9728-08ca11062bf4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:10.947701 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-421a95cc-a5e7-4257-9728-08ca11062bf4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:10.956671 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-421a95cc-a5e7-4257-9728-08ca11062bf4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:10.957503 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-421a95cc-a5e7-4257-9728-08ca11062bf4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:10.958447 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-421a95cc-a5e7-4257-9728-08ca11062bf4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:10.959680 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-421a95cc-a5e7-4257-9728-08ca11062bf4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:11.008489 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-ec4eb2f2-0a4e-435a-81ed-0dc80e10c7ec tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:11.010097 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-ec4eb2f2-0a4e-435a-81ed-0dc80e10c7ec tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 6bc2024c-c05e-4409-a142-e8cf3191a203] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:11.017607 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ec4eb2f2-0a4e-435a-81ed-0dc80e10c7ec tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:11.018576 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ec4eb2f2-0a4e-435a-81ed-0dc80e10c7ec tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:11.019839 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ec4eb2f2-0a4e-435a-81ed-0dc80e10c7ec tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:11.020570 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ec4eb2f2-0a4e-435a-81ed-0dc80e10c7ec tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:11.226447 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-421a95cc-a5e7-4257-9728-08ca11062bf4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:11.229781 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-ec4eb2f2-0a4e-435a-81ed-0dc80e10c7ec tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:11.238786 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-ec4eb2f2-0a4e-435a-81ed-0dc80e10c7ec tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203" status: 200 len: 1366 microversion: 2.1 time: 0.235482 Jun 30 10:41:11.242151 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-421a95cc-a5e7-4257-9728-08ca11062bf4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:11.244385 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-421a95cc-a5e7-4257-9728-08ca11062bf4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:11.246752 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-421a95cc-a5e7-4257-9728-08ca11062bf4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1407 microversion: 2.20 time: 0.304320 Jun 30 10:41:11.247573 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 115/219] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:41:10 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1407 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:41:11.249235 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 105/220] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:11 2022] GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203 => generated 1366 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:41:11.265056 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-e0407164-1ff6-4be8-b75b-f1981c8497b5 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:11.268770 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-e0407164-1ff6-4be8-b75b-f1981c8497b5 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] [instance: 68b71cd8-d4e6-4646-acf7-317020683d8c] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:11.281629 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-e0407164-1ff6-4be8-b75b-f1981c8497b5 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:11.282594 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-e0407164-1ff6-4be8-b75b-f1981c8497b5 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:11.284212 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-e0407164-1ff6-4be8-b75b-f1981c8497b5 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:11.285769 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-e0407164-1ff6-4be8-b75b-f1981c8497b5 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:11.383849 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-e0407164-1ff6-4be8-b75b-f1981c8497b5 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c0ccbf16fe4a399945aa5ad34754b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ed6f6064a4cd88a03cf97ab7abeae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:11.393349 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-e0407164-1ff6-4be8-b75b-f1981c8497b5 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] 10.222.0.59 "GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c" status: 200 len: 1265 microversion: 2.1 time: 0.144381 Jun 30 10:41:11.394371 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 116/221] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:11 2022] GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c => generated 1265 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:11.513503 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-f9630e28-7447-424f-9b76-bdd55194aa08 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:11.514328 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-f9630e28-7447-424f-9b76-bdd55194aa08 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:11.525864 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-f9630e28-7447-424f-9b76-bdd55194aa08 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:11.526383 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-f9630e28-7447-424f-9b76-bdd55194aa08 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:11.527183 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-f9630e28-7447-424f-9b76-bdd55194aa08 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:11.528704 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-f9630e28-7447-424f-9b76-bdd55194aa08 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:11.547192 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-cf8344b7-1b56-454e-b1b5-cb5b9e1cfb21 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:11.547192 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-cf8344b7-1b56-454e-b1b5-cb5b9e1cfb21 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:11.549631 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_api:SELECT=100 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:41:11.556540 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-cf8344b7-1b56-454e-b1b5-cb5b9e1cfb21 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:11.557246 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-cf8344b7-1b56-454e-b1b5-cb5b9e1cfb21 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:11.562186 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-cf8344b7-1b56-454e-b1b5-cb5b9e1cfb21 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:11.562649 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-cf8344b7-1b56-454e-b1b5-cb5b9e1cfb21 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:11.791248 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-f9630e28-7447-424f-9b76-bdd55194aa08 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:11.802724 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-f9630e28-7447-424f-9b76-bdd55194aa08 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1321 microversion: 2.1 time: 0.293570 Jun 30 10:41:11.808261 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 106/222] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:11 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1321 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:11.808442 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-cf8344b7-1b56-454e-b1b5-cb5b9e1cfb21 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:11.814804 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-cf8344b7-1b56-454e-b1b5-cb5b9e1cfb21 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1363 microversion: 2.1 time: 0.275275 Jun 30 10:41:11.815505 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 117/223] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:11 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1363 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:41:11.839928 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-a892ce15-e0ba-4756-8e36-975826f940dd tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:11.840494 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-a892ce15-e0ba-4756-8e36-975826f940dd tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] [instance: 5c8d5bc5-4671-4189-94e0-1442e872fc2d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:11.850416 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a892ce15-e0ba-4756-8e36-975826f940dd tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:11.850983 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a892ce15-e0ba-4756-8e36-975826f940dd tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:11.851866 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a892ce15-e0ba-4756-8e36-975826f940dd tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:11.852367 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a892ce15-e0ba-4756-8e36-975826f940dd tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:12.035179 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-a892ce15-e0ba-4756-8e36-975826f940dd tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad75a8b887a4a40accb49603f03c8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d27fbbe7475782fe2202e34aec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:12.044890 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-a892ce15-e0ba-4756-8e36-975826f940dd tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] 10.222.0.59 "GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d" status: 200 len: 1314 microversion: 2.1 time: 0.208579 Jun 30 10:41:12.045527 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 107/224] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:11 2022] GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:12.256711 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-61ddc0b3-5c54-451e-8826-87c017992e9a tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:12.258272 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-61ddc0b3-5c54-451e-8826-87c017992e9a tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 6bc2024c-c05e-4409-a142-e8cf3191a203] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:12.269819 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-61ddc0b3-5c54-451e-8826-87c017992e9a tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:12.271163 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-61ddc0b3-5c54-451e-8826-87c017992e9a tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:12.272429 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-61ddc0b3-5c54-451e-8826-87c017992e9a tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:12.274390 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-61ddc0b3-5c54-451e-8826-87c017992e9a tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:12.275035 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-59f62b99-4f91-45aa-9ac2-6798f58c6ebb tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:12.276146 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-59f62b99-4f91-45aa-9ac2-6798f58c6ebb tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:12.284074 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-59f62b99-4f91-45aa-9ac2-6798f58c6ebb tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:12.285047 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-59f62b99-4f91-45aa-9ac2-6798f58c6ebb tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:12.286271 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-59f62b99-4f91-45aa-9ac2-6798f58c6ebb tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:12.287432 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-59f62b99-4f91-45aa-9ac2-6798f58c6ebb tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:12.499341 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-61ddc0b3-5c54-451e-8826-87c017992e9a tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:12.502185 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-59f62b99-4f91-45aa-9ac2-6798f58c6ebb tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:12.510803 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-59f62b99-4f91-45aa-9ac2-6798f58c6ebb tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:12.512775 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-61ddc0b3-5c54-451e-8826-87c017992e9a tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203" status: 200 len: 1366 microversion: 2.1 time: 0.260983 Jun 30 10:41:12.513376 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 118/225] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:12 2022] GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203 => generated 1366 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:12.520615 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-7aa29fed-7ddf-4994-a76e-dae4ca563140 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:12.521300 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-7aa29fed-7ddf-4994-a76e-dae4ca563140 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] [instance: 68b71cd8-d4e6-4646-acf7-317020683d8c] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:12.525291 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-59f62b99-4f91-45aa-9ac2-6798f58c6ebb tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:12.526993 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-59f62b99-4f91-45aa-9ac2-6798f58c6ebb tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1407 microversion: 2.20 time: 0.259317 Jun 30 10:41:12.527555 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 108/226] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:41:12 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1407 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:41:12.528727 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-7aa29fed-7ddf-4994-a76e-dae4ca563140 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:12.529359 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-7aa29fed-7ddf-4994-a76e-dae4ca563140 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:12.531496 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-7aa29fed-7ddf-4994-a76e-dae4ca563140 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:12.532674 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-7aa29fed-7ddf-4994-a76e-dae4ca563140 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:12.603872 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-7aa29fed-7ddf-4994-a76e-dae4ca563140 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c0ccbf16fe4a399945aa5ad34754b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ed6f6064a4cd88a03cf97ab7abeae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:12.614832 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-7aa29fed-7ddf-4994-a76e-dae4ca563140 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] 10.222.0.59 "GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c" status: 200 len: 1265 microversion: 2.1 time: 0.100370 Jun 30 10:41:12.615850 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 119/227] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:12 2022] GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c => generated 1265 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:12.821087 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-2a8d48e4-e365-450c-b386-14d447eea36e tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:12.821792 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-2a8d48e4-e365-450c-b386-14d447eea36e tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:12.831447 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-51e7491d-74b4-497e-80ff-e18053325307 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:12.832010 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-51e7491d-74b4-497e-80ff-e18053325307 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:12.833171 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-2a8d48e4-e365-450c-b386-14d447eea36e tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:12.834478 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-2a8d48e4-e365-450c-b386-14d447eea36e tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:12.836310 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-2a8d48e4-e365-450c-b386-14d447eea36e tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:12.836881 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-2a8d48e4-e365-450c-b386-14d447eea36e tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:12.839327 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-51e7491d-74b4-497e-80ff-e18053325307 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:12.839784 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-51e7491d-74b4-497e-80ff-e18053325307 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:12.841230 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-51e7491d-74b4-497e-80ff-e18053325307 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:12.841828 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-51e7491d-74b4-497e-80ff-e18053325307 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:13.047276 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-2a8d48e4-e365-450c-b386-14d447eea36e tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:13.049991 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-51e7491d-74b4-497e-80ff-e18053325307 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:13.055188 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-2a8d48e4-e365-450c-b386-14d447eea36e tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1321 microversion: 2.1 time: 0.238546 Jun 30 10:41:13.055816 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 109/228] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:12 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1321 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:13.057416 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-51e7491d-74b4-497e-80ff-e18053325307 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1363 microversion: 2.1 time: 0.230015 Jun 30 10:41:13.057978 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 120/229] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:12 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1363 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:13.067480 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-ce834603-72f2-4488-91ef-b06bad58b595 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:13.068160 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-ce834603-72f2-4488-91ef-b06bad58b595 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] [instance: 5c8d5bc5-4671-4189-94e0-1442e872fc2d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:13.074800 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ce834603-72f2-4488-91ef-b06bad58b595 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:13.075239 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ce834603-72f2-4488-91ef-b06bad58b595 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:13.076018 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ce834603-72f2-4488-91ef-b06bad58b595 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:13.076442 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ce834603-72f2-4488-91ef-b06bad58b595 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:13.209358 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-ce834603-72f2-4488-91ef-b06bad58b595 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad75a8b887a4a40accb49603f03c8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d27fbbe7475782fe2202e34aec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:13.216946 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-ce834603-72f2-4488-91ef-b06bad58b595 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] 10.222.0.59 "GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d" status: 200 len: 1314 microversion: 2.1 time: 0.154501 Jun 30 10:41:13.218143 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 110/230] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:13 2022] GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:13.530661 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-87915fa5-c0cf-4ae7-aa59-5c72515cc96d tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:13.531300 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-87915fa5-c0cf-4ae7-aa59-5c72515cc96d tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 6bc2024c-c05e-4409-a142-e8cf3191a203] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:13.538566 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-87915fa5-c0cf-4ae7-aa59-5c72515cc96d tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:13.538566 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-87915fa5-c0cf-4ae7-aa59-5c72515cc96d tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:13.543157 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-87915fa5-c0cf-4ae7-aa59-5c72515cc96d tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:13.543454 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-cd9c37f9-a817-4949-b8dc-d0bba32e609c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:13.544066 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-cd9c37f9-a817-4949-b8dc-d0bba32e609c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:13.544738 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-87915fa5-c0cf-4ae7-aa59-5c72515cc96d tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:13.550433 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-cd9c37f9-a817-4949-b8dc-d0bba32e609c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:13.551090 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-cd9c37f9-a817-4949-b8dc-d0bba32e609c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:13.551885 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-cd9c37f9-a817-4949-b8dc-d0bba32e609c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:13.552479 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-cd9c37f9-a817-4949-b8dc-d0bba32e609c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:13.746089 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-87915fa5-c0cf-4ae7-aa59-5c72515cc96d tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:13.750807 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-cd9c37f9-a817-4949-b8dc-d0bba32e609c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:13.753836 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-87915fa5-c0cf-4ae7-aa59-5c72515cc96d tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203" status: 200 len: 1366 microversion: 2.1 time: 0.227618 Jun 30 10:41:13.754628 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 121/231] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:13 2022] GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203 => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:13.759054 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-dbd28690-50ee-4596-b928-294f520ee3e7 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:13.759657 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-dbd28690-50ee-4596-b928-294f520ee3e7 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] [instance: 68b71cd8-d4e6-4646-acf7-317020683d8c] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:13.768043 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-cd9c37f9-a817-4949-b8dc-d0bba32e609c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:13.769018 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-dbd28690-50ee-4596-b928-294f520ee3e7 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:13.769465 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-dbd28690-50ee-4596-b928-294f520ee3e7 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:13.769699 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-cd9c37f9-a817-4949-b8dc-d0bba32e609c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:13.770819 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-dbd28690-50ee-4596-b928-294f520ee3e7 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:13.770940 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-cd9c37f9-a817-4949-b8dc-d0bba32e609c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1407 microversion: 2.20 time: 0.231113 Jun 30 10:41:13.771266 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-dbd28690-50ee-4596-b928-294f520ee3e7 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:13.771395 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 111/232] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:41:13 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1407 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:41:13.837206 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-dbd28690-50ee-4596-b928-294f520ee3e7 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c0ccbf16fe4a399945aa5ad34754b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ed6f6064a4cd88a03cf97ab7abeae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:13.845297 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-dbd28690-50ee-4596-b928-294f520ee3e7 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] 10.222.0.59 "GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c" status: 200 len: 1265 microversion: 2.1 time: 0.089674 Jun 30 10:41:13.846209 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 122/233] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:13 2022] GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c => generated 1265 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:14.073839 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-02238e06-ee0e-45eb-8f86-cc598fd1028a tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:14.074449 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-02238e06-ee0e-45eb-8f86-cc598fd1028a tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:14.074874 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-2dda9486-cb25-4e0e-980a-833c9e1145bb tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:14.075482 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-2dda9486-cb25-4e0e-980a-833c9e1145bb tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:14.083292 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-02238e06-ee0e-45eb-8f86-cc598fd1028a tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:14.083760 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-02238e06-ee0e-45eb-8f86-cc598fd1028a tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:14.084763 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-02238e06-ee0e-45eb-8f86-cc598fd1028a tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:14.085382 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-2dda9486-cb25-4e0e-980a-833c9e1145bb tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:14.085511 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-02238e06-ee0e-45eb-8f86-cc598fd1028a tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:14.086084 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-2dda9486-cb25-4e0e-980a-833c9e1145bb tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:14.087019 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-2dda9486-cb25-4e0e-980a-833c9e1145bb tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:14.087598 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-2dda9486-cb25-4e0e-980a-833c9e1145bb tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:14.303797 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-2dda9486-cb25-4e0e-980a-833c9e1145bb tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:14.325429 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-2dda9486-cb25-4e0e-980a-833c9e1145bb tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1363 microversion: 2.1 time: 0.254400 Jun 30 10:41:14.326065 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 123/234] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:14 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1363 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:41:14.330829 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [req-0867a728-7013-42a0-a15a-f94ebcd28b01 req-0e3ff7cf-9f25-4eab-955a-57dcdd3959bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8379d7c-c539-4cb8-9c06-886aff24e725", "name": "network-vif-plugged", "status": "completed", "tag": "4d656245-ccde-4b1f-a74a-7077e762ec01"}]} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:41:14.359432 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-0867a728-7013-42a0-a15a-f94ebcd28b01 req-0e3ff7cf-9f25-4eab-955a-57dcdd3959bb service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:14.359886 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-0867a728-7013-42a0-a15a-f94ebcd28b01 req-0e3ff7cf-9f25-4eab-955a-57dcdd3959bb service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:14.375018 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-02238e06-ee0e-45eb-8f86-cc598fd1028a tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:14.387286 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.compute.server_external_events [req-0867a728-7013-42a0-a15a-f94ebcd28b01 req-0e3ff7cf-9f25-4eab-955a-57dcdd3959bb service nova] Creating event network-vif-plugged:4d656245-ccde-4b1f-a74a-7077e762ec01 for instance a8379d7c-c539-4cb8-9c06-886aff24e725 on hv-cinder-82282 Jun 30 10:41:14.391913 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-02238e06-ee0e-45eb-8f86-cc598fd1028a tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1321 microversion: 2.1 time: 0.322026 Jun 30 10:41:14.394633 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 112/235] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:14 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1321 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:14.406979 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [req-0867a728-7013-42a0-a15a-f94ebcd28b01 req-0e3ff7cf-9f25-4eab-955a-57dcdd3959bb service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079552 Jun 30 10:41:14.408149 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 124/236] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:41:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:41:14.408616 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-ff55d4e5-85cd-4844-bf72-ad115d68a675 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:14.409256 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-ff55d4e5-85cd-4844-bf72-ad115d68a675 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] [instance: 5c8d5bc5-4671-4189-94e0-1442e872fc2d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:14.423426 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ff55d4e5-85cd-4844-bf72-ad115d68a675 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:14.424270 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ff55d4e5-85cd-4844-bf72-ad115d68a675 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:14.425342 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ff55d4e5-85cd-4844-bf72-ad115d68a675 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:14.433039 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ff55d4e5-85cd-4844-bf72-ad115d68a675 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:14.592695 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-ff55d4e5-85cd-4844-bf72-ad115d68a675 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad75a8b887a4a40accb49603f03c8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d27fbbe7475782fe2202e34aec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:14.596677 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_cell1:SELECT=100 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:41:14.602781 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-ff55d4e5-85cd-4844-bf72-ad115d68a675 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] 10.222.0.59 "GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d" status: 200 len: 1501 microversion: 2.1 time: 0.205167 Jun 30 10:41:14.603370 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 113/237] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:14 2022] GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d => generated 1501 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:14.771961 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-8992bbe0-3f97-4e59-ac96-ca334fc8b975 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:14.772931 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-8992bbe0-3f97-4e59-ac96-ca334fc8b975 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 6bc2024c-c05e-4409-a142-e8cf3191a203] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:14.780401 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-8992bbe0-3f97-4e59-ac96-ca334fc8b975 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:14.781134 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-8992bbe0-3f97-4e59-ac96-ca334fc8b975 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:14.782132 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-8992bbe0-3f97-4e59-ac96-ca334fc8b975 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:14.782669 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-8992bbe0-3f97-4e59-ac96-ca334fc8b975 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:14.793764 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-e47e77de-c6d7-46d7-9e64-ec92fa93b11e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:14.794691 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-e47e77de-c6d7-46d7-9e64-ec92fa93b11e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:14.803938 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e47e77de-c6d7-46d7-9e64-ec92fa93b11e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:14.804645 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e47e77de-c6d7-46d7-9e64-ec92fa93b11e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:14.806720 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e47e77de-c6d7-46d7-9e64-ec92fa93b11e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:14.807349 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e47e77de-c6d7-46d7-9e64-ec92fa93b11e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:15.031525 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-8992bbe0-3f97-4e59-ac96-ca334fc8b975 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:15.034805 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-e47e77de-c6d7-46d7-9e64-ec92fa93b11e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:15.039808 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-8992bbe0-3f97-4e59-ac96-ca334fc8b975 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203" status: 200 len: 1366 microversion: 2.1 time: 0.272621 Jun 30 10:41:15.040709 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 125/238] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:14 2022] GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203 => generated 1366 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:15.044483 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-e47e77de-c6d7-46d7-9e64-ec92fa93b11e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:15.045277 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-a1515d99-7a27-4ceb-b599-b2ee65efa0b1 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:15.045846 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-a1515d99-7a27-4ceb-b599-b2ee65efa0b1 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] [instance: 68b71cd8-d4e6-4646-acf7-317020683d8c] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:15.046344 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-e47e77de-c6d7-46d7-9e64-ec92fa93b11e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:15.047930 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-e47e77de-c6d7-46d7-9e64-ec92fa93b11e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1407 microversion: 2.20 time: 0.260868 Jun 30 10:41:15.049205 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 114/239] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:41:14 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1407 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:41:15.054184 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a1515d99-7a27-4ceb-b599-b2ee65efa0b1 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:15.054904 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a1515d99-7a27-4ceb-b599-b2ee65efa0b1 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:15.055755 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a1515d99-7a27-4ceb-b599-b2ee65efa0b1 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:15.056246 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a1515d99-7a27-4ceb-b599-b2ee65efa0b1 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:15.121376 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-a1515d99-7a27-4ceb-b599-b2ee65efa0b1 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c0ccbf16fe4a399945aa5ad34754b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ed6f6064a4cd88a03cf97ab7abeae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:15.129432 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-a1515d99-7a27-4ceb-b599-b2ee65efa0b1 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] 10.222.0.59 "GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c" status: 200 len: 1265 microversion: 2.1 time: 0.087604 Jun 30 10:41:15.129996 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 126/240] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:15 2022] GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c => generated 1265 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:15.342019 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-385db813-9bc9-4d1c-86fc-6b00098b9b3f tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:15.342629 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-385db813-9bc9-4d1c-86fc-6b00098b9b3f tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:15.348627 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-385db813-9bc9-4d1c-86fc-6b00098b9b3f tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:15.349075 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-385db813-9bc9-4d1c-86fc-6b00098b9b3f tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:15.349830 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-385db813-9bc9-4d1c-86fc-6b00098b9b3f tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:15.350265 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-385db813-9bc9-4d1c-86fc-6b00098b9b3f tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:15.411001 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-7aa8ee54-aa29-4f83-b24e-570fb84ac679 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:15.411611 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-7aa8ee54-aa29-4f83-b24e-570fb84ac679 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:15.417646 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-7aa8ee54-aa29-4f83-b24e-570fb84ac679 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:15.418086 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-7aa8ee54-aa29-4f83-b24e-570fb84ac679 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:15.418867 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-7aa8ee54-aa29-4f83-b24e-570fb84ac679 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:15.419733 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-7aa8ee54-aa29-4f83-b24e-570fb84ac679 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:15.591207 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-385db813-9bc9-4d1c-86fc-6b00098b9b3f tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:15.598690 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-385db813-9bc9-4d1c-86fc-6b00098b9b3f tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1363 microversion: 2.1 time: 0.260517 Jun 30 10:41:15.599298 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 115/241] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:15 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1363 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:15.643048 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-7aa8ee54-aa29-4f83-b24e-570fb84ac679 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:15.650609 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-7aa8ee54-aa29-4f83-b24e-570fb84ac679 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1321 microversion: 2.1 time: 0.243841 Jun 30 10:41:15.651262 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 127/242] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:15 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1321 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:41:16.056884 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-08fe708e-aafa-4bc4-9f35-9bd734bd1786 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:16.057482 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-08fe708e-aafa-4bc4-9f35-9bd734bd1786 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 6bc2024c-c05e-4409-a142-e8cf3191a203] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:16.060315 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:41:16.065348 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-08fe708e-aafa-4bc4-9f35-9bd734bd1786 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:16.065788 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-08fe708e-aafa-4bc4-9f35-9bd734bd1786 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:16.066540 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-08fe708e-aafa-4bc4-9f35-9bd734bd1786 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:16.066967 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-08fe708e-aafa-4bc4-9f35-9bd734bd1786 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:16.068681 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-d643155d-2f3e-47bb-afdf-8cfea3e248cf tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:16.070311 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-d643155d-2f3e-47bb-afdf-8cfea3e248cf tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:16.084810 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d643155d-2f3e-47bb-afdf-8cfea3e248cf tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:16.085255 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d643155d-2f3e-47bb-afdf-8cfea3e248cf tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:16.086153 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d643155d-2f3e-47bb-afdf-8cfea3e248cf tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:16.086447 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d643155d-2f3e-47bb-afdf-8cfea3e248cf tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:16.285873 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-08fe708e-aafa-4bc4-9f35-9bd734bd1786 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:16.292792 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-d643155d-2f3e-47bb-afdf-8cfea3e248cf tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:16.295901 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-08fe708e-aafa-4bc4-9f35-9bd734bd1786 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203" status: 200 len: 1366 microversion: 2.1 time: 0.242212 Jun 30 10:41:16.296483 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 116/243] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:16 2022] GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203 => generated 1366 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:16.301473 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-4dfa99aa-9600-4876-8bcb-9605d9d10bc8 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:16.301609 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-d643155d-2f3e-47bb-afdf-8cfea3e248cf tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:16.302279 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-4dfa99aa-9600-4876-8bcb-9605d9d10bc8 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] [instance: 68b71cd8-d4e6-4646-acf7-317020683d8c] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:16.303742 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-d643155d-2f3e-47bb-afdf-8cfea3e248cf tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:16.306811 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-d643155d-2f3e-47bb-afdf-8cfea3e248cf tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1407 microversion: 2.20 time: 0.242480 Jun 30 10:41:16.307782 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 128/244] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:41:16 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1407 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 10:41:16.308361 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-4dfa99aa-9600-4876-8bcb-9605d9d10bc8 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:16.308846 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-4dfa99aa-9600-4876-8bcb-9605d9d10bc8 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:16.309611 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-4dfa99aa-9600-4876-8bcb-9605d9d10bc8 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:16.310077 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-4dfa99aa-9600-4876-8bcb-9605d9d10bc8 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:16.372600 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-4dfa99aa-9600-4876-8bcb-9605d9d10bc8 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c0ccbf16fe4a399945aa5ad34754b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ed6f6064a4cd88a03cf97ab7abeae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:16.380080 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-4dfa99aa-9600-4876-8bcb-9605d9d10bc8 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] 10.222.0.59 "GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c" status: 200 len: 1265 microversion: 2.1 time: 0.082309 Jun 30 10:41:16.380966 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 117/245] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:16 2022] GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c => generated 1265 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:16.427781 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [req-cb693859-f924-4d0c-8fa5-9af09cfaf367 req-af779afb-f3a2-4ac0-a6ff-49f5e9fad133 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bc2024c-c05e-4409-a142-e8cf3191a203", "name": "network-vif-plugged", "status": "completed", "tag": "90e52b50-5114-40c4-a042-20650fd1b094"}]} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:41:16.436924 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-cb693859-f924-4d0c-8fa5-9af09cfaf367 req-af779afb-f3a2-4ac0-a6ff-49f5e9fad133 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:16.437373 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-cb693859-f924-4d0c-8fa5-9af09cfaf367 req-af779afb-f3a2-4ac0-a6ff-49f5e9fad133 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:16.448253 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.compute.server_external_events [req-cb693859-f924-4d0c-8fa5-9af09cfaf367 req-af779afb-f3a2-4ac0-a6ff-49f5e9fad133 service nova] Creating event network-vif-plugged:90e52b50-5114-40c4-a042-20650fd1b094 for instance 6bc2024c-c05e-4409-a142-e8cf3191a203 on hv-cinder-82282 Jun 30 10:41:16.453695 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [req-cb693859-f924-4d0c-8fa5-9af09cfaf367 req-af779afb-f3a2-4ac0-a6ff-49f5e9fad133 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029873 Jun 30 10:41:16.454277 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 129/246] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:41:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:41:16.615427 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-921ddec4-3ba2-43d1-b74e-c828018c5030 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:16.616322 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-921ddec4-3ba2-43d1-b74e-c828018c5030 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:16.622753 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-921ddec4-3ba2-43d1-b74e-c828018c5030 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:16.623203 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-921ddec4-3ba2-43d1-b74e-c828018c5030 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:16.623966 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-921ddec4-3ba2-43d1-b74e-c828018c5030 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:16.624406 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-921ddec4-3ba2-43d1-b74e-c828018c5030 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:16.667810 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-6df5763e-ff11-4004-9bb4-d8e72df40133 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:16.668523 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-6df5763e-ff11-4004-9bb4-d8e72df40133 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:16.675298 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6df5763e-ff11-4004-9bb4-d8e72df40133 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:16.675747 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6df5763e-ff11-4004-9bb4-d8e72df40133 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:16.676495 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6df5763e-ff11-4004-9bb4-d8e72df40133 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:16.676942 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6df5763e-ff11-4004-9bb4-d8e72df40133 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:16.806101 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-921ddec4-3ba2-43d1-b74e-c828018c5030 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:16.814742 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-921ddec4-3ba2-43d1-b74e-c828018c5030 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1363 microversion: 2.1 time: 0.203141 Jun 30 10:41:16.815325 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 118/247] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:16 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1363 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:16.858209 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-6df5763e-ff11-4004-9bb4-d8e72df40133 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:16.866876 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-6df5763e-ff11-4004-9bb4-d8e72df40133 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1321 microversion: 2.1 time: 0.203442 Jun 30 10:41:16.867436 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 130/248] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:16 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1321 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:41:17.313623 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-f200a22c-0a8b-4d55-b75f-407b591fec3d tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:17.314418 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-f200a22c-0a8b-4d55-b75f-407b591fec3d tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 6bc2024c-c05e-4409-a142-e8cf3191a203] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:17.316420 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_cell0:SELECT=2 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:41:17.317271 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_cell0:SELECT=6 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:41:17.323591 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-f200a22c-0a8b-4d55-b75f-407b591fec3d tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:17.324047 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-f200a22c-0a8b-4d55-b75f-407b591fec3d tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:17.324996 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-f200a22c-0a8b-4d55-b75f-407b591fec3d tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:17.325431 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-f200a22c-0a8b-4d55-b75f-407b591fec3d tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:17.332684 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-0b35dc1f-ff3c-46ae-a897-5470070b2ef2 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:17.333296 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-0b35dc1f-ff3c-46ae-a897-5470070b2ef2 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:17.339640 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-0b35dc1f-ff3c-46ae-a897-5470070b2ef2 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:17.340098 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-0b35dc1f-ff3c-46ae-a897-5470070b2ef2 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:17.340894 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-0b35dc1f-ff3c-46ae-a897-5470070b2ef2 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:17.341331 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-0b35dc1f-ff3c-46ae-a897-5470070b2ef2 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:17.367449 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_cell0:SELECT=2 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:41:17.550257 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-f200a22c-0a8b-4d55-b75f-407b591fec3d tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:17.553424 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-0b35dc1f-ff3c-46ae-a897-5470070b2ef2 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:17.558022 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-f200a22c-0a8b-4d55-b75f-407b591fec3d tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203" status: 200 len: 1366 microversion: 2.1 time: 0.248895 Jun 30 10:41:17.558586 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 119/249] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:17 2022] GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203 => generated 1366 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:17.561865 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-0b35dc1f-ff3c-46ae-a897-5470070b2ef2 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:17.563373 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-0b35dc1f-ff3c-46ae-a897-5470070b2ef2 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:17.563729 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-42c09e59-488f-4283-b0e1-2780e9d4f055 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:17.564262 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-42c09e59-488f-4283-b0e1-2780e9d4f055 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] [instance: 68b71cd8-d4e6-4646-acf7-317020683d8c] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:17.564472 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-0b35dc1f-ff3c-46ae-a897-5470070b2ef2 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1407 microversion: 2.20 time: 0.235739 Jun 30 10:41:17.565218 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 131/250] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:41:17 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1407 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 10:41:17.569950 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-42c09e59-488f-4283-b0e1-2780e9d4f055 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:17.570455 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-42c09e59-488f-4283-b0e1-2780e9d4f055 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:17.571267 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-42c09e59-488f-4283-b0e1-2780e9d4f055 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:17.571775 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-42c09e59-488f-4283-b0e1-2780e9d4f055 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:17.631724 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-42c09e59-488f-4283-b0e1-2780e9d4f055 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c0ccbf16fe4a399945aa5ad34754b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ed6f6064a4cd88a03cf97ab7abeae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:17.638933 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-42c09e59-488f-4283-b0e1-2780e9d4f055 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] 10.222.0.59 "GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c" status: 200 len: 1265 microversion: 2.1 time: 0.079280 Jun 30 10:41:17.639781 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 120/251] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:17 2022] GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c => generated 1265 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:17.831166 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-6058af2f-3625-4232-8595-caf0bb0d586c tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:17.831704 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-6058af2f-3625-4232-8595-caf0bb0d586c tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:17.837690 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6058af2f-3625-4232-8595-caf0bb0d586c tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:17.838134 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6058af2f-3625-4232-8595-caf0bb0d586c tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:17.838882 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6058af2f-3625-4232-8595-caf0bb0d586c tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:17.839309 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6058af2f-3625-4232-8595-caf0bb0d586c tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:17.843713 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_cell1:SELECT=100 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:41:17.884422 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-f7d2c90d-a009-473a-ae51-e7a4971db494 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:17.885056 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-f7d2c90d-a009-473a-ae51-e7a4971db494 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:17.890992 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-f7d2c90d-a009-473a-ae51-e7a4971db494 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:17.891441 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-f7d2c90d-a009-473a-ae51-e7a4971db494 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:17.892386 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-f7d2c90d-a009-473a-ae51-e7a4971db494 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:17.892850 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-f7d2c90d-a009-473a-ae51-e7a4971db494 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:18.019927 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-6058af2f-3625-4232-8595-caf0bb0d586c tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:18.027606 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-6058af2f-3625-4232-8595-caf0bb0d586c tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1363 microversion: 2.1 time: 0.200307 Jun 30 10:41:18.028274 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 132/252] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:17 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1363 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:41:18.046496 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-f7d2c90d-a009-473a-ae51-e7a4971db494 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:18.053726 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-f7d2c90d-a009-473a-ae51-e7a4971db494 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1321 microversion: 2.1 time: 0.173258 Jun 30 10:41:18.054283 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 121/253] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:17 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:18.574940 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-43a39fad-2f4f-4cf0-904b-55a54e9baa4e tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:18.575545 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-43a39fad-2f4f-4cf0-904b-55a54e9baa4e tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 6bc2024c-c05e-4409-a142-e8cf3191a203] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:18.582282 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-43a39fad-2f4f-4cf0-904b-55a54e9baa4e tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:18.582745 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-43a39fad-2f4f-4cf0-904b-55a54e9baa4e tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:18.582845 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-4df34ef9-de60-4060-a508-09c337272fa4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:18.583420 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-4df34ef9-de60-4060-a508-09c337272fa4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:18.583514 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-43a39fad-2f4f-4cf0-904b-55a54e9baa4e tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:18.583952 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-43a39fad-2f4f-4cf0-904b-55a54e9baa4e tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:18.589461 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-4df34ef9-de60-4060-a508-09c337272fa4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:18.589905 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-4df34ef9-de60-4060-a508-09c337272fa4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:18.590690 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-4df34ef9-de60-4060-a508-09c337272fa4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:18.591125 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-4df34ef9-de60-4060-a508-09c337272fa4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:18.777181 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-43a39fad-2f4f-4cf0-904b-55a54e9baa4e tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:18.784186 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-4df34ef9-de60-4060-a508-09c337272fa4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:18.785525 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-43a39fad-2f4f-4cf0-904b-55a54e9baa4e tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203" status: 200 len: 1366 microversion: 2.1 time: 0.214338 Jun 30 10:41:18.786107 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 133/254] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:18 2022] GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203 => generated 1366 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:18.794810 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-fcda8258-b6f8-4837-8860-2808519a0a1a tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:18.794810 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-fcda8258-b6f8-4837-8860-2808519a0a1a tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] [instance: 68b71cd8-d4e6-4646-acf7-317020683d8c] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:18.795008 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-4df34ef9-de60-4060-a508-09c337272fa4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:18.795008 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-4df34ef9-de60-4060-a508-09c337272fa4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:18.795008 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-4df34ef9-de60-4060-a508-09c337272fa4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1407 microversion: 2.20 time: 0.215751 Jun 30 10:41:18.795533 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 122/255] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:41:18 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1407 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 10:41:18.798514 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-fcda8258-b6f8-4837-8860-2808519a0a1a tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:18.799000 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-fcda8258-b6f8-4837-8860-2808519a0a1a tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:18.799900 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-fcda8258-b6f8-4837-8860-2808519a0a1a tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:18.800340 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-fcda8258-b6f8-4837-8860-2808519a0a1a tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:18.859900 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-fcda8258-b6f8-4837-8860-2808519a0a1a tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c0ccbf16fe4a399945aa5ad34754b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ed6f6064a4cd88a03cf97ab7abeae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:18.867148 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-fcda8258-b6f8-4837-8860-2808519a0a1a tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] 10.222.0.59 "GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c" status: 200 len: 1265 microversion: 2.1 time: 0.079270 Jun 30 10:41:18.867716 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 134/256] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:18 2022] GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c => generated 1265 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:19.045003 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-c669f3d6-b2ea-4157-b4f0-da7e8b2824ed tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:19.045572 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-c669f3d6-b2ea-4157-b4f0-da7e8b2824ed tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:19.051731 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c669f3d6-b2ea-4157-b4f0-da7e8b2824ed tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:19.052165 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c669f3d6-b2ea-4157-b4f0-da7e8b2824ed tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:19.052947 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c669f3d6-b2ea-4157-b4f0-da7e8b2824ed tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:19.053369 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c669f3d6-b2ea-4157-b4f0-da7e8b2824ed tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:19.070465 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-4dee9612-f01d-415a-8c64-b16cae0e3fb1 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:19.071080 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-4dee9612-f01d-415a-8c64-b16cae0e3fb1 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:19.078057 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-4dee9612-f01d-415a-8c64-b16cae0e3fb1 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:19.078508 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-4dee9612-f01d-415a-8c64-b16cae0e3fb1 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:19.079281 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-4dee9612-f01d-415a-8c64-b16cae0e3fb1 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:19.079732 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-4dee9612-f01d-415a-8c64-b16cae0e3fb1 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:19.418264 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-c669f3d6-b2ea-4157-b4f0-da7e8b2824ed tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:19.421576 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-4dee9612-f01d-415a-8c64-b16cae0e3fb1 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:19.431599 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-4dee9612-f01d-415a-8c64-b16cae0e3fb1 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1321 microversion: 2.1 time: 0.364961 Jun 30 10:41:19.433134 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-c669f3d6-b2ea-4157-b4f0-da7e8b2824ed tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1363 microversion: 2.1 time: 0.391832 Jun 30 10:41:19.443025 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 135/257] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:19 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1321 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:41:19.443173 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 123/258] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:19 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1363 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:19.802723 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-67c809b1-be22-4e59-a128-f3ea716ac602 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:19.803365 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-67c809b1-be22-4e59-a128-f3ea716ac602 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 6bc2024c-c05e-4409-a142-e8cf3191a203] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:19.809645 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-67c809b1-be22-4e59-a128-f3ea716ac602 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:19.810093 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-67c809b1-be22-4e59-a128-f3ea716ac602 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:19.810896 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-67c809b1-be22-4e59-a128-f3ea716ac602 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:19.811849 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-67c809b1-be22-4e59-a128-f3ea716ac602 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:19.813116 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-65bfc44e-ea03-4530-a7a1-56f41fcc1f02 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:19.813721 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-65bfc44e-ea03-4530-a7a1-56f41fcc1f02 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:19.819657 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-65bfc44e-ea03-4530-a7a1-56f41fcc1f02 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:19.820106 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-65bfc44e-ea03-4530-a7a1-56f41fcc1f02 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:19.820891 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-65bfc44e-ea03-4530-a7a1-56f41fcc1f02 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:19.821342 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-65bfc44e-ea03-4530-a7a1-56f41fcc1f02 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:20.000275 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-67c809b1-be22-4e59-a128-f3ea716ac602 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:20.007023 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-65bfc44e-ea03-4530-a7a1-56f41fcc1f02 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:20.007870 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-67c809b1-be22-4e59-a128-f3ea716ac602 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203" status: 200 len: 1366 microversion: 2.1 time: 0.208990 Jun 30 10:41:20.008447 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 136/259] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:19 2022] GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203 => generated 1366 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:20.012876 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-a6191442-c0ca-457e-aeb2-596aa8072df9 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:20.013473 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-a6191442-c0ca-457e-aeb2-596aa8072df9 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] [instance: 68b71cd8-d4e6-4646-acf7-317020683d8c] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:20.015379 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-65bfc44e-ea03-4530-a7a1-56f41fcc1f02 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:20.016899 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-65bfc44e-ea03-4530-a7a1-56f41fcc1f02 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:20.018213 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-65bfc44e-ea03-4530-a7a1-56f41fcc1f02 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1598 microversion: 2.20 time: 0.209883 Jun 30 10:41:20.018766 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 124/260] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:41:19 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1598 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 10:41:20.019096 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a6191442-c0ca-457e-aeb2-596aa8072df9 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:20.019600 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a6191442-c0ca-457e-aeb2-596aa8072df9 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:20.020361 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a6191442-c0ca-457e-aeb2-596aa8072df9 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:20.020817 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a6191442-c0ca-457e-aeb2-596aa8072df9 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:20.036618 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-d1280596-685b-43fc-ae65-87ed722fe5e6 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:20.037108 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-d1280596-685b-43fc-ae65-87ed722fe5e6 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:20.042852 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-d1280596-685b-43fc-ae65-87ed722fe5e6 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:20.043292 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-d1280596-685b-43fc-ae65-87ed722fe5e6 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:20.044038 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-d1280596-685b-43fc-ae65-87ed722fe5e6 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:20.044467 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-d1280596-685b-43fc-ae65-87ed722fe5e6 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:20.081424 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-a6191442-c0ca-457e-aeb2-596aa8072df9 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c0ccbf16fe4a399945aa5ad34754b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ed6f6064a4cd88a03cf97ab7abeae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:20.090487 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-a6191442-c0ca-457e-aeb2-596aa8072df9 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] 10.222.0.59 "GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c" status: 200 len: 1265 microversion: 2.1 time: 0.081012 Jun 30 10:41:20.091632 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 137/261] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:20 2022] GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c => generated 1265 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:20.166012 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-d1280596-685b-43fc-ae65-87ed722fe5e6 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.133044 Jun 30 10:41:20.166606 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 125/262] 10.222.0.59 () {60 vars in 1315 bytes} [Thu Jun 30 10:41:20 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8/os-interface => generated 284 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 30 10:41:20.231658 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-604a2b1a-aa15-4768-8890-2c227945db1f tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c8923324-8fc0-4250-b2ba-b54755216a27"}} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:41:20.232868 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-604a2b1a-aa15-4768-8890-2c227945db1f tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] [instance: 5c8d5bc5-4671-4189-94e0-1442e872fc2d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:20.239164 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-604a2b1a-aa15-4768-8890-2c227945db1f tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:20.239612 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-604a2b1a-aa15-4768-8890-2c227945db1f tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:20.240373 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-604a2b1a-aa15-4768-8890-2c227945db1f tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:20.240832 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-604a2b1a-aa15-4768-8890-2c227945db1f tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:20.450665 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-e53c6a7f-0225-4388-8b48-81fe3971eaed tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:20.452256 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-e53c6a7f-0225-4388-8b48-81fe3971eaed tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:20.458659 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e53c6a7f-0225-4388-8b48-81fe3971eaed tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:20.459314 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e53c6a7f-0225-4388-8b48-81fe3971eaed tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:20.460082 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e53c6a7f-0225-4388-8b48-81fe3971eaed tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:20.460492 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e53c6a7f-0225-4388-8b48-81fe3971eaed tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:20.757608 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-e53c6a7f-0225-4388-8b48-81fe3971eaed tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:20.765573 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-e53c6a7f-0225-4388-8b48-81fe3971eaed tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1514 microversion: 2.1 time: 0.318860 Jun 30 10:41:20.766136 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 126/263] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:20 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1514 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:41:20.770484 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-ad729c36-6a73-473c-9581-9c87ebf74fa9 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:20.771101 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-ad729c36-6a73-473c-9581-9c87ebf74fa9 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:20.777137 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ad729c36-6a73-473c-9581-9c87ebf74fa9 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:20.777573 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ad729c36-6a73-473c-9581-9c87ebf74fa9 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:20.778329 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ad729c36-6a73-473c-9581-9c87ebf74fa9 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:20.778753 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ad729c36-6a73-473c-9581-9c87ebf74fa9 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:21.078242 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-ad729c36-6a73-473c-9581-9c87ebf74fa9 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:21.085830 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-ad729c36-6a73-473c-9581-9c87ebf74fa9 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1363 microversion: 2.1 time: 0.318712 Jun 30 10:41:21.086595 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 127/264] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:20 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1363 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:21.091648 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-60bc062e-b748-4096-b66c-e0b3d9ae56ec tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:41:21.092681 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-60bc062e-b748-4096-b66c-e0b3d9ae56ec tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:21.098662 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-60bc062e-b748-4096-b66c-e0b3d9ae56ec tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:21.099112 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-60bc062e-b748-4096-b66c-e0b3d9ae56ec tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:21.099872 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-60bc062e-b748-4096-b66c-e0b3d9ae56ec tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:21.100308 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-60bc062e-b748-4096-b66c-e0b3d9ae56ec tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:21.126295 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.objects.instance [None req-60bc062e-b748-4096-b66c-e0b3d9ae56ec tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lazy-loading 'flavor' on Instance uuid ecd0d1a0-003c-4199-984a-80b41602909f {{(pid=124203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 10:41:21.234343 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:41:21.246714 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-60bc062e-b748-4096-b66c-e0b3d9ae56ec tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "POST /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f/action" status: 200 len: 32 microversion: 2.1 time: 0.158904 Jun 30 10:41:21.247347 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 128/265] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Jun 30 10:41:21 2022] POST /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f/action => generated 32 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 30 10:41:21.253274 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-69c9a6eb-eddb-46e7-a099-34c60941e396 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:21.253973 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-69c9a6eb-eddb-46e7-a099-34c60941e396 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 6bc2024c-c05e-4409-a142-e8cf3191a203] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:21.262017 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-69c9a6eb-eddb-46e7-a099-34c60941e396 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:21.262462 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-69c9a6eb-eddb-46e7-a099-34c60941e396 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:21.263239 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-69c9a6eb-eddb-46e7-a099-34c60941e396 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:21.263670 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-69c9a6eb-eddb-46e7-a099-34c60941e396 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:21.507120 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-69c9a6eb-eddb-46e7-a099-34c60941e396 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:21.514615 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-69c9a6eb-eddb-46e7-a099-34c60941e396 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203" status: 200 len: 1366 microversion: 2.1 time: 0.266142 Jun 30 10:41:21.515220 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 129/266] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:21 2022] GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203 => generated 1366 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:21.521455 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-12ce050a-98e0-4401-8c4e-9a5dc74561e0 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:21.521898 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-12ce050a-98e0-4401-8c4e-9a5dc74561e0 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] [instance: 68b71cd8-d4e6-4646-acf7-317020683d8c] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:21.527766 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-12ce050a-98e0-4401-8c4e-9a5dc74561e0 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:21.528216 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-12ce050a-98e0-4401-8c4e-9a5dc74561e0 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:21.529000 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-12ce050a-98e0-4401-8c4e-9a5dc74561e0 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:21.529438 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-12ce050a-98e0-4401-8c4e-9a5dc74561e0 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:21.645708 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-12ce050a-98e0-4401-8c4e-9a5dc74561e0 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c0ccbf16fe4a399945aa5ad34754b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ed6f6064a4cd88a03cf97ab7abeae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:21.653224 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-12ce050a-98e0-4401-8c4e-9a5dc74561e0 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] 10.222.0.59 "GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c" status: 200 len: 1265 microversion: 2.1 time: 0.137016 Jun 30 10:41:21.653796 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 130/267] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:21 2022] GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c => generated 1265 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:21.658660 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-14ff51f6-d41f-46be-bd7e-08156b6e74b5 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:21.659259 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-14ff51f6-d41f-46be-bd7e-08156b6e74b5 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:21.665013 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-14ff51f6-d41f-46be-bd7e-08156b6e74b5 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:21.665464 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-14ff51f6-d41f-46be-bd7e-08156b6e74b5 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:21.666221 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-14ff51f6-d41f-46be-bd7e-08156b6e74b5 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:21.666653 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-14ff51f6-d41f-46be-bd7e-08156b6e74b5 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:21.814936 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-14ff51f6-d41f-46be-bd7e-08156b6e74b5 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:21.823577 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-14ff51f6-d41f-46be-bd7e-08156b6e74b5 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1520 microversion: 2.1 time: 0.168770 Jun 30 10:41:21.824583 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 131/268] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:21 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:21.929456 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [req-d0d074af-9983-4cc0-bc8d-5c1c14472039 req-f9cada49-9a20-4f9f-a73f-971c66cbc2c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af0d59b6-8e95-4947-803a-c1d952e218c8", "tag": "ec009e37-3070-46e8-8a9a-513065a2c654"}]} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:41:21.937311 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-d0d074af-9983-4cc0-bc8d-5c1c14472039 req-f9cada49-9a20-4f9f-a73f-971c66cbc2c9 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:21.937743 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-d0d074af-9983-4cc0-bc8d-5c1c14472039 req-f9cada49-9a20-4f9f-a73f-971c66cbc2c9 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:21.950672 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.compute.server_external_events [req-d0d074af-9983-4cc0-bc8d-5c1c14472039 req-f9cada49-9a20-4f9f-a73f-971c66cbc2c9 service nova] Creating event network-changed:ec009e37-3070-46e8-8a9a-513065a2c654 for instance af0d59b6-8e95-4947-803a-c1d952e218c8 on hv-cinder-82282 Jun 30 10:41:21.956069 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [req-d0d074af-9983-4cc0-bc8d-5c1c14472039 req-f9cada49-9a20-4f9f-a73f-971c66cbc2c9 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085798 Jun 30 10:41:21.956693 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 132/269] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:41:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 10:41:22.103342 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-d59e3c31-4674-4a2c-b36d-b3b00ff299f8 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:22.104113 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-d59e3c31-4674-4a2c-b36d-b3b00ff299f8 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:22.110592 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-d59e3c31-4674-4a2c-b36d-b3b00ff299f8 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:22.111033 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-d59e3c31-4674-4a2c-b36d-b3b00ff299f8 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:22.111788 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-d59e3c31-4674-4a2c-b36d-b3b00ff299f8 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:22.112219 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-d59e3c31-4674-4a2c-b36d-b3b00ff299f8 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:22.247945 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-d59e3c31-4674-4a2c-b36d-b3b00ff299f8 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:22.256084 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-d59e3c31-4674-4a2c-b36d-b3b00ff299f8 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1363 microversion: 2.1 time: 0.157134 Jun 30 10:41:22.256735 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 133/270] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:22 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:41:22.531116 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-0c9a9495-53d2-44bd-aa14-d4c4b1490117 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:22.531717 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-0c9a9495-53d2-44bd-aa14-d4c4b1490117 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 6bc2024c-c05e-4409-a142-e8cf3191a203] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:22.537786 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0c9a9495-53d2-44bd-aa14-d4c4b1490117 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:22.538231 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0c9a9495-53d2-44bd-aa14-d4c4b1490117 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:22.538994 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0c9a9495-53d2-44bd-aa14-d4c4b1490117 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:22.539425 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0c9a9495-53d2-44bd-aa14-d4c4b1490117 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:22.671998 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-0c9a9495-53d2-44bd-aa14-d4c4b1490117 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:22.680042 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-0c9a9495-53d2-44bd-aa14-d4c4b1490117 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203" status: 200 len: 1366 microversion: 2.1 time: 0.152653 Jun 30 10:41:22.680640 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 134/271] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:22 2022] GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:41:22.685231 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-16d7259b-5a2f-4c08-8969-baeecd6b4b30 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:22.686453 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-16d7259b-5a2f-4c08-8969-baeecd6b4b30 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] [instance: 68b71cd8-d4e6-4646-acf7-317020683d8c] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:22.692442 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-16d7259b-5a2f-4c08-8969-baeecd6b4b30 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:22.692926 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-16d7259b-5a2f-4c08-8969-baeecd6b4b30 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:22.693671 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-16d7259b-5a2f-4c08-8969-baeecd6b4b30 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:22.694096 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-16d7259b-5a2f-4c08-8969-baeecd6b4b30 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:22.756095 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-16d7259b-5a2f-4c08-8969-baeecd6b4b30 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c0ccbf16fe4a399945aa5ad34754b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ed6f6064a4cd88a03cf97ab7abeae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:22.764238 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-16d7259b-5a2f-4c08-8969-baeecd6b4b30 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] 10.222.0.59 "GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c" status: 200 len: 1265 microversion: 2.1 time: 0.082132 Jun 30 10:41:22.764453 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 135/272] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:22 2022] GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c => generated 1265 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:22.840641 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-63b2c6bd-0317-4088-8305-57bfaede8904 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:22.841238 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-63b2c6bd-0317-4088-8305-57bfaede8904 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:22.847975 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-63b2c6bd-0317-4088-8305-57bfaede8904 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:22.848421 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-63b2c6bd-0317-4088-8305-57bfaede8904 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:22.849233 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-63b2c6bd-0317-4088-8305-57bfaede8904 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:22.849666 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-63b2c6bd-0317-4088-8305-57bfaede8904 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:22.985709 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-63b2c6bd-0317-4088-8305-57bfaede8904 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:22.993840 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-63b2c6bd-0317-4088-8305-57bfaede8904 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1520 microversion: 2.1 time: 0.157018 Jun 30 10:41:22.994607 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 136/273] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:22 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:41:23.273489 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-f9b0e27a-8aa2-472e-822b-af95aa65e520 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:23.274150 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-f9b0e27a-8aa2-472e-822b-af95aa65e520 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:23.280939 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-f9b0e27a-8aa2-472e-822b-af95aa65e520 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:23.281383 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-f9b0e27a-8aa2-472e-822b-af95aa65e520 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:23.282146 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-f9b0e27a-8aa2-472e-822b-af95aa65e520 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:23.282576 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-f9b0e27a-8aa2-472e-822b-af95aa65e520 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:23.411766 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-f9b0e27a-8aa2-472e-822b-af95aa65e520 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:23.419113 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-f9b0e27a-8aa2-472e-822b-af95aa65e520 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1363 microversion: 2.1 time: 0.149504 Jun 30 10:41:23.419877 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 137/274] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:23 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:41:23.696605 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-c2ed5b40-37c8-4c08-b295-3d8a22505fa6 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:23.697217 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-c2ed5b40-37c8-4c08-b295-3d8a22505fa6 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 6bc2024c-c05e-4409-a142-e8cf3191a203] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:23.703823 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c2ed5b40-37c8-4c08-b295-3d8a22505fa6 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:23.704270 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c2ed5b40-37c8-4c08-b295-3d8a22505fa6 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:23.705065 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c2ed5b40-37c8-4c08-b295-3d8a22505fa6 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:23.705507 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c2ed5b40-37c8-4c08-b295-3d8a22505fa6 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:23.833449 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-c2ed5b40-37c8-4c08-b295-3d8a22505fa6 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:23.840872 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-c2ed5b40-37c8-4c08-b295-3d8a22505fa6 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203" status: 200 len: 1366 microversion: 2.1 time: 0.148052 Jun 30 10:41:23.841630 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 138/275] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:23 2022] GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:41:23.845768 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-adabff4c-cc6e-493d-b847-8435542fb673 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:23.846364 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-adabff4c-cc6e-493d-b847-8435542fb673 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] [instance: 68b71cd8-d4e6-4646-acf7-317020683d8c] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:23.854076 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-adabff4c-cc6e-493d-b847-8435542fb673 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:23.854076 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-adabff4c-cc6e-493d-b847-8435542fb673 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:23.854076 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-adabff4c-cc6e-493d-b847-8435542fb673 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:23.854076 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-adabff4c-cc6e-493d-b847-8435542fb673 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:23.912561 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-adabff4c-cc6e-493d-b847-8435542fb673 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c0ccbf16fe4a399945aa5ad34754b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ed6f6064a4cd88a03cf97ab7abeae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:23.919772 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-adabff4c-cc6e-493d-b847-8435542fb673 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] 10.222.0.59 "GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c" status: 200 len: 1265 microversion: 2.1 time: 0.077399 Jun 30 10:41:23.920342 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 139/276] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:23 2022] GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c => generated 1265 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:24.010087 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-1fcc8733-4f97-465a-afa9-701ab29e5b59 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:24.010618 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-1fcc8733-4f97-465a-afa9-701ab29e5b59 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:24.016881 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-1fcc8733-4f97-465a-afa9-701ab29e5b59 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:24.017319 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-1fcc8733-4f97-465a-afa9-701ab29e5b59 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:24.018109 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-1fcc8733-4f97-465a-afa9-701ab29e5b59 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:24.018537 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-1fcc8733-4f97-465a-afa9-701ab29e5b59 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:24.144648 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-1fcc8733-4f97-465a-afa9-701ab29e5b59 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:24.152234 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-1fcc8733-4f97-465a-afa9-701ab29e5b59 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1520 microversion: 2.1 time: 0.145966 Jun 30 10:41:24.152852 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 140/277] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:24 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1520 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:41:24.435212 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-13acb279-d120-45fe-8cf2-8d14f7e6c1b1 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:24.436783 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-13acb279-d120-45fe-8cf2-8d14f7e6c1b1 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:24.442708 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-13acb279-d120-45fe-8cf2-8d14f7e6c1b1 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:24.443188 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-13acb279-d120-45fe-8cf2-8d14f7e6c1b1 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:24.443986 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-13acb279-d120-45fe-8cf2-8d14f7e6c1b1 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:24.444467 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-13acb279-d120-45fe-8cf2-8d14f7e6c1b1 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:24.583537 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-13acb279-d120-45fe-8cf2-8d14f7e6c1b1 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:24.591082 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-13acb279-d120-45fe-8cf2-8d14f7e6c1b1 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1363 microversion: 2.1 time: 0.159807 Jun 30 10:41:24.591649 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 141/278] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:24 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:41:24.858125 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-e78fa4c6-f9bf-42b2-9765-52f96f6bf435 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:24.858629 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-e78fa4c6-f9bf-42b2-9765-52f96f6bf435 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 6bc2024c-c05e-4409-a142-e8cf3191a203] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:24.864694 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e78fa4c6-f9bf-42b2-9765-52f96f6bf435 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:24.865140 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e78fa4c6-f9bf-42b2-9765-52f96f6bf435 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:24.865908 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e78fa4c6-f9bf-42b2-9765-52f96f6bf435 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:24.866344 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e78fa4c6-f9bf-42b2-9765-52f96f6bf435 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:24.999256 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-e78fa4c6-f9bf-42b2-9765-52f96f6bf435 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:25.006925 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-e78fa4c6-f9bf-42b2-9765-52f96f6bf435 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203" status: 200 len: 1366 microversion: 2.1 time: 0.152879 Jun 30 10:41:25.007582 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 142/279] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:24 2022] GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:41:25.012170 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-e4ace582-2a10-4c71-bba5-7ce5f28acea8 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:25.012858 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-e4ace582-2a10-4c71-bba5-7ce5f28acea8 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] [instance: 68b71cd8-d4e6-4646-acf7-317020683d8c] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:25.019456 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e4ace582-2a10-4c71-bba5-7ce5f28acea8 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:25.019896 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e4ace582-2a10-4c71-bba5-7ce5f28acea8 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:25.020712 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e4ace582-2a10-4c71-bba5-7ce5f28acea8 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:25.021138 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e4ace582-2a10-4c71-bba5-7ce5f28acea8 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:25.081944 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-e4ace582-2a10-4c71-bba5-7ce5f28acea8 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c0ccbf16fe4a399945aa5ad34754b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ed6f6064a4cd88a03cf97ab7abeae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:25.090752 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-e4ace582-2a10-4c71-bba5-7ce5f28acea8 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] 10.222.0.59 "GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c" status: 200 len: 1265 microversion: 2.1 time: 0.082158 Jun 30 10:41:25.091364 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 143/280] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:25 2022] GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c => generated 1265 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:25.170976 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-576947e4-fb99-4a34-b1f4-33d03e75624b tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:25.171577 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-576947e4-fb99-4a34-b1f4-33d03e75624b tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:25.178229 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-576947e4-fb99-4a34-b1f4-33d03e75624b tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:25.178682 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-576947e4-fb99-4a34-b1f4-33d03e75624b tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:25.179503 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-576947e4-fb99-4a34-b1f4-33d03e75624b tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:25.179934 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-576947e4-fb99-4a34-b1f4-33d03e75624b tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:25.312562 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-576947e4-fb99-4a34-b1f4-33d03e75624b tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:25.319930 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-576947e4-fb99-4a34-b1f4-33d03e75624b tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1520 microversion: 2.1 time: 0.152836 Jun 30 10:41:25.320511 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 144/281] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:25 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:41:25.621027 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-9f23bdb4-0b5d-468e-8043-2f5cb98f1fe9 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:25.624859 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-9f23bdb4-0b5d-468e-8043-2f5cb98f1fe9 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:25.642682 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-9f23bdb4-0b5d-468e-8043-2f5cb98f1fe9 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:25.643225 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-9f23bdb4-0b5d-468e-8043-2f5cb98f1fe9 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:25.644562 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-9f23bdb4-0b5d-468e-8043-2f5cb98f1fe9 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:25.644696 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-9f23bdb4-0b5d-468e-8043-2f5cb98f1fe9 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:25.816235 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-604a2b1a-aa15-4768-8890-2c227945db1f tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] 10.222.0.59 "POST /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.588572 Jun 30 10:41:25.825170 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 138/282] 10.222.0.59 () {60 vars in 1322 bytes} [Thu Jun 30 10:41:20 2022] POST /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d/os-volume_attachments => generated 194 bytes in 5598 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 10:41:25.936781 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-9f23bdb4-0b5d-468e-8043-2f5cb98f1fe9 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:25.944412 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-9f23bdb4-0b5d-468e-8043-2f5cb98f1fe9 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1363 microversion: 2.1 time: 0.340047 Jun 30 10:41:25.945195 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 145/283] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:25 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1363 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:26.025827 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-76bc52e9-4456-475a-aa34-7ea95c7e782c tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:26.026802 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-76bc52e9-4456-475a-aa34-7ea95c7e782c tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 6bc2024c-c05e-4409-a142-e8cf3191a203] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:26.039706 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-76bc52e9-4456-475a-aa34-7ea95c7e782c tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:26.040810 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-76bc52e9-4456-475a-aa34-7ea95c7e782c tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:26.042065 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-76bc52e9-4456-475a-aa34-7ea95c7e782c tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:26.042606 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-76bc52e9-4456-475a-aa34-7ea95c7e782c tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:26.108531 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-763f05cd-b2bb-4972-a0d4-3e9f04e0fdaf tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:26.109422 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-763f05cd-b2bb-4972-a0d4-3e9f04e0fdaf tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] [instance: 68b71cd8-d4e6-4646-acf7-317020683d8c] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:26.120562 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-763f05cd-b2bb-4972-a0d4-3e9f04e0fdaf tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:26.121297 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-763f05cd-b2bb-4972-a0d4-3e9f04e0fdaf tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:26.122240 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-763f05cd-b2bb-4972-a0d4-3e9f04e0fdaf tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:26.123474 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-763f05cd-b2bb-4972-a0d4-3e9f04e0fdaf tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:26.128626 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_cell1:SELECT=100 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:41:26.221424 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-763f05cd-b2bb-4972-a0d4-3e9f04e0fdaf tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c0ccbf16fe4a399945aa5ad34754b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ed6f6064a4cd88a03cf97ab7abeae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:26.232184 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-763f05cd-b2bb-4972-a0d4-3e9f04e0fdaf tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] 10.222.0.59 "GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c" status: 200 len: 1271 microversion: 2.1 time: 0.128732 Jun 30 10:41:26.232826 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 146/284] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:26 2022] GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c => generated 1271 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:41:26.299042 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-76bc52e9-4456-475a-aa34-7ea95c7e782c tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:26.306478 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-76bc52e9-4456-475a-aa34-7ea95c7e782c tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203" status: 200 len: 1366 microversion: 2.1 time: 0.285645 Jun 30 10:41:26.307175 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 139/285] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:26 2022] GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203 => generated 1366 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:26.337897 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-55100d28-0f5b-4042-aa52-ba019aa83ecd tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:26.338714 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-55100d28-0f5b-4042-aa52-ba019aa83ecd tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:26.345380 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-55100d28-0f5b-4042-aa52-ba019aa83ecd tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:26.346037 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-55100d28-0f5b-4042-aa52-ba019aa83ecd tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:26.346804 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-55100d28-0f5b-4042-aa52-ba019aa83ecd tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:26.347392 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-55100d28-0f5b-4042-aa52-ba019aa83ecd tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:26.549383 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-55100d28-0f5b-4042-aa52-ba019aa83ecd tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:26.557014 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-55100d28-0f5b-4042-aa52-ba019aa83ecd tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1520 microversion: 2.1 time: 0.223335 Jun 30 10:41:26.557592 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 147/286] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:26 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1520 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:26.969279 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-ee3d6540-7983-4a98-ad6f-99c882edf688 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:26.969900 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-ee3d6540-7983-4a98-ad6f-99c882edf688 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:26.991540 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ee3d6540-7983-4a98-ad6f-99c882edf688 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:26.992242 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ee3d6540-7983-4a98-ad6f-99c882edf688 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:26.993118 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ee3d6540-7983-4a98-ad6f-99c882edf688 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:26.993556 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ee3d6540-7983-4a98-ad6f-99c882edf688 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:27.207315 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-ee3d6540-7983-4a98-ad6f-99c882edf688 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:27.218682 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-ee3d6540-7983-4a98-ad6f-99c882edf688 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1363 microversion: 2.1 time: 0.253813 Jun 30 10:41:27.219125 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 140/287] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:26 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1363 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:27.249783 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-2dc4c60e-87af-4d14-b901-5880ba150c64 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:27.250407 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-2dc4c60e-87af-4d14-b901-5880ba150c64 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] [instance: 68b71cd8-d4e6-4646-acf7-317020683d8c] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:27.256377 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-2dc4c60e-87af-4d14-b901-5880ba150c64 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:27.257056 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-2dc4c60e-87af-4d14-b901-5880ba150c64 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:27.257959 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-2dc4c60e-87af-4d14-b901-5880ba150c64 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:27.259191 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-2dc4c60e-87af-4d14-b901-5880ba150c64 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:27.323297 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-59b32e4b-edc0-42c9-a637-fa91b2f1199f tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:27.323918 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-59b32e4b-edc0-42c9-a637-fa91b2f1199f tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 6bc2024c-c05e-4409-a142-e8cf3191a203] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:27.332772 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-59b32e4b-edc0-42c9-a637-fa91b2f1199f tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:27.333358 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-59b32e4b-edc0-42c9-a637-fa91b2f1199f tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:27.334133 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-59b32e4b-edc0-42c9-a637-fa91b2f1199f tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:27.334563 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-59b32e4b-edc0-42c9-a637-fa91b2f1199f tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:27.634212 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-2dc4c60e-87af-4d14-b901-5880ba150c64 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c0ccbf16fe4a399945aa5ad34754b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ed6f6064a4cd88a03cf97ab7abeae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:27.640145 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-59b32e4b-edc0-42c9-a637-fa91b2f1199f tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:27.646271 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-2dc4c60e-87af-4d14-b901-5880ba150c64 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] 10.222.0.59 "GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c" status: 200 len: 1313 microversion: 2.1 time: 0.400331 Jun 30 10:41:27.655709 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 148/288] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:27 2022] GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c => generated 1313 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:41:27.655866 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-59b32e4b-edc0-42c9-a637-fa91b2f1199f tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203" status: 200 len: 1366 microversion: 2.1 time: 0.328142 Jun 30 10:41:27.655866 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 141/289] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:27 2022] GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203 => generated 1366 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:41:27.656045 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-c3b9e3df-2630-4827-80b2-e66a514e0d30 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:27.656045 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-c3b9e3df-2630-4827-80b2-e66a514e0d30 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:27.659817 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c3b9e3df-2630-4827-80b2-e66a514e0d30 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:27.660264 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c3b9e3df-2630-4827-80b2-e66a514e0d30 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:27.661058 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c3b9e3df-2630-4827-80b2-e66a514e0d30 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:27.661515 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c3b9e3df-2630-4827-80b2-e66a514e0d30 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:27.909590 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-c3b9e3df-2630-4827-80b2-e66a514e0d30 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:27.917819 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-c3b9e3df-2630-4827-80b2-e66a514e0d30 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1520 microversion: 2.1 time: 0.269480 Jun 30 10:41:27.918395 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 149/290] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:27 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1520 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:28.237119 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-d7ef8558-bbe1-4eda-a353-5be0c14626c6 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:28.238365 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-d7ef8558-bbe1-4eda-a353-5be0c14626c6 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:28.250441 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d7ef8558-bbe1-4eda-a353-5be0c14626c6 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:28.251272 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d7ef8558-bbe1-4eda-a353-5be0c14626c6 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:28.252382 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d7ef8558-bbe1-4eda-a353-5be0c14626c6 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:28.253151 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d7ef8558-bbe1-4eda-a353-5be0c14626c6 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:28.552152 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-d7ef8558-bbe1-4eda-a353-5be0c14626c6 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:28.560964 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-d7ef8558-bbe1-4eda-a353-5be0c14626c6 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1363 microversion: 2.1 time: 0.328388 Jun 30 10:41:28.561857 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 142/291] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:28 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1363 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:28.663713 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-fd6c3930-37ad-49a4-8964-dab0a173ed0b tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:28.664360 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-fd6c3930-37ad-49a4-8964-dab0a173ed0b tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] [instance: 68b71cd8-d4e6-4646-acf7-317020683d8c] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:28.667462 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-a997816c-1595-442a-aefb-202123075b7d tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:28.668209 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-a997816c-1595-442a-aefb-202123075b7d tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 6bc2024c-c05e-4409-a142-e8cf3191a203] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:28.672609 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-fd6c3930-37ad-49a4-8964-dab0a173ed0b tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:28.673185 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-fd6c3930-37ad-49a4-8964-dab0a173ed0b tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:28.674477 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-fd6c3930-37ad-49a4-8964-dab0a173ed0b tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:28.676829 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-fd6c3930-37ad-49a4-8964-dab0a173ed0b tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:28.678263 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a997816c-1595-442a-aefb-202123075b7d tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:28.679022 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a997816c-1595-442a-aefb-202123075b7d tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:28.680445 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a997816c-1595-442a-aefb-202123075b7d tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:28.682109 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a997816c-1595-442a-aefb-202123075b7d tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:28.920958 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-a997816c-1595-442a-aefb-202123075b7d tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:28.925164 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-fd6c3930-37ad-49a4-8964-dab0a173ed0b tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c0ccbf16fe4a399945aa5ad34754b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ed6f6064a4cd88a03cf97ab7abeae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:28.929420 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-a997816c-1595-442a-aefb-202123075b7d tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203" status: 200 len: 1366 microversion: 2.1 time: 0.267224 Jun 30 10:41:28.930000 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 143/292] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:28 2022] GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203 => generated 1366 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:28.940777 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-fd6c3930-37ad-49a4-8964-dab0a173ed0b tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] 10.222.0.59 "GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c" status: 200 len: 1313 microversion: 2.1 time: 0.281287 Jun 30 10:41:28.941534 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 150/293] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:28 2022] GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c => generated 1313 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:28.946277 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-056f9bf1-b36e-432f-9869-6a5ef8178334 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:28.946875 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-056f9bf1-b36e-432f-9869-6a5ef8178334 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:28.950491 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [req-f44155f8-8e67-48f7-bfe0-5ce3019b2226 req-dee01bf3-e115-427d-8111-94989b890a45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68b71cd8-d4e6-4646-acf7-317020683d8c", "tag": "ad7f39dc-4189-449d-90a6-f5875e739022"}]} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:41:28.953278 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-056f9bf1-b36e-432f-9869-6a5ef8178334 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:28.953725 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-056f9bf1-b36e-432f-9869-6a5ef8178334 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:28.954489 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-056f9bf1-b36e-432f-9869-6a5ef8178334 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:28.954915 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-056f9bf1-b36e-432f-9869-6a5ef8178334 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:28.959155 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-f44155f8-8e67-48f7-bfe0-5ce3019b2226 req-dee01bf3-e115-427d-8111-94989b890a45 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:28.959590 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-f44155f8-8e67-48f7-bfe0-5ce3019b2226 req-dee01bf3-e115-427d-8111-94989b890a45 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:28.970506 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.compute.server_external_events [req-f44155f8-8e67-48f7-bfe0-5ce3019b2226 req-dee01bf3-e115-427d-8111-94989b890a45 service nova] Creating event network-changed:ad7f39dc-4189-449d-90a6-f5875e739022 for instance 68b71cd8-d4e6-4646-acf7-317020683d8c on hv-cinder-82282 Jun 30 10:41:28.975147 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [req-f44155f8-8e67-48f7-bfe0-5ce3019b2226 req-dee01bf3-e115-427d-8111-94989b890a45 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043881 Jun 30 10:41:28.975736 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 144/294] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:41:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:41:29.095104 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-056f9bf1-b36e-432f-9869-6a5ef8178334 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:29.103309 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-056f9bf1-b36e-432f-9869-6a5ef8178334 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1520 microversion: 2.1 time: 0.160930 Jun 30 10:41:29.103882 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 151/295] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:28 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:29.579389 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-01646177-3f83-4e8a-b29a-9a449465b365 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:29.580204 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-01646177-3f83-4e8a-b29a-9a449465b365 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:29.586381 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-01646177-3f83-4e8a-b29a-9a449465b365 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:29.586814 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-01646177-3f83-4e8a-b29a-9a449465b365 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:29.587933 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-01646177-3f83-4e8a-b29a-9a449465b365 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:29.588360 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-01646177-3f83-4e8a-b29a-9a449465b365 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:29.731145 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-01646177-3f83-4e8a-b29a-9a449465b365 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:29.739100 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-01646177-3f83-4e8a-b29a-9a449465b365 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1549 microversion: 2.1 time: 0.164327 Jun 30 10:41:29.739687 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 145/296] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:29 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1549 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:29.755659 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-140f76cb-01fb-4d1c-913d-bcccd6933cbb tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:29.756181 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-140f76cb-01fb-4d1c-913d-bcccd6933cbb tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:29.762187 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-140f76cb-01fb-4d1c-913d-bcccd6933cbb tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:29.762639 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-140f76cb-01fb-4d1c-913d-bcccd6933cbb tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:29.763393 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-140f76cb-01fb-4d1c-913d-bcccd6933cbb tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:29.763861 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-140f76cb-01fb-4d1c-913d-bcccd6933cbb tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:29.838045 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-140f76cb-01fb-4d1c-913d-bcccd6933cbb tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.086238 Jun 30 10:41:29.838643 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 152/297] 10.222.0.59 () {58 vars in 1274 bytes} [Thu Jun 30 10:41:29 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725/os-interface => generated 285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 10:41:29.947018 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-9626904a-be9b-4733-9188-56bfec3011a3 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:29.947622 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-9626904a-be9b-4733-9188-56bfec3011a3 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 6bc2024c-c05e-4409-a142-e8cf3191a203] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:29.954195 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-9626904a-be9b-4733-9188-56bfec3011a3 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:29.954638 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-9626904a-be9b-4733-9188-56bfec3011a3 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:29.955391 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-9626904a-be9b-4733-9188-56bfec3011a3 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:29.955825 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-9626904a-be9b-4733-9188-56bfec3011a3 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:29.958516 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-187c40d5-958a-48c6-9607-c9bd9faeb465 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:29.959285 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-187c40d5-958a-48c6-9607-c9bd9faeb465 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] [instance: 68b71cd8-d4e6-4646-acf7-317020683d8c] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:29.966507 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-187c40d5-958a-48c6-9607-c9bd9faeb465 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:29.967539 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-187c40d5-958a-48c6-9607-c9bd9faeb465 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:29.968306 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-187c40d5-958a-48c6-9607-c9bd9faeb465 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:29.968784 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-187c40d5-958a-48c6-9607-c9bd9faeb465 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:30.304469 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-9626904a-be9b-4733-9188-56bfec3011a3 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:30.312448 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-9626904a-be9b-4733-9188-56bfec3011a3 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203" status: 200 len: 1556 microversion: 2.1 time: 0.369260 Jun 30 10:41:30.313053 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 146/298] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:29 2022] GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203 => generated 1556 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:30.317426 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-6282181c-c6ae-4648-98de-feceb31c97a7 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:30.318028 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-6282181c-c6ae-4648-98de-feceb31c97a7 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:30.323831 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6282181c-c6ae-4648-98de-feceb31c97a7 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:30.324479 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6282181c-c6ae-4648-98de-feceb31c97a7 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:30.325194 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6282181c-c6ae-4648-98de-feceb31c97a7 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:30.325638 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6282181c-c6ae-4648-98de-feceb31c97a7 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:30.341494 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-187c40d5-958a-48c6-9607-c9bd9faeb465 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c0ccbf16fe4a399945aa5ad34754b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ed6f6064a4cd88a03cf97ab7abeae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:30.349507 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-187c40d5-958a-48c6-9607-c9bd9faeb465 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] 10.222.0.59 "GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c" status: 200 len: 1313 microversion: 2.1 time: 0.395539 Jun 30 10:41:30.350091 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 153/299] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:29 2022] GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c => generated 1313 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:41:30.354865 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-63ea9f1e-4d61-4eab-aab8-7c2f3a1b8ece tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:30.355698 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-63ea9f1e-4d61-4eab-aab8-7c2f3a1b8ece tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 6bc2024c-c05e-4409-a142-e8cf3191a203] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:30.362387 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-63ea9f1e-4d61-4eab-aab8-7c2f3a1b8ece tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:30.362833 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-63ea9f1e-4d61-4eab-aab8-7c2f3a1b8ece tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:30.363596 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-63ea9f1e-4d61-4eab-aab8-7c2f3a1b8ece tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:30.364029 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-63ea9f1e-4d61-4eab-aab8-7c2f3a1b8ece tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:30.494042 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-63ea9f1e-4d61-4eab-aab8-7c2f3a1b8ece tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.142705 Jun 30 10:41:30.494642 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 154/300] 10.222.0.59 () {58 vars in 1274 bytes} [Thu Jun 30 10:41:30 2022] GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203/os-interface => generated 284 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:41:30.579223 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-6282181c-c6ae-4648-98de-feceb31c97a7 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:30.588009 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-6282181c-c6ae-4648-98de-feceb31c97a7 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1520 microversion: 2.1 time: 0.273928 Jun 30 10:41:30.592960 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 147/301] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:30 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1520 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:31.219447 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [req-2c3d2e34-3333-4726-8efe-12579941601c req-5861d910-7b42-4c37-b7f6-3f9605d265f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8379d7c-c539-4cb8-9c06-886aff24e725", "tag": "4d656245-ccde-4b1f-a74a-7077e762ec01"}]} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:41:31.236370 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-2c3d2e34-3333-4726-8efe-12579941601c req-5861d910-7b42-4c37-b7f6-3f9605d265f8 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:31.236957 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-2c3d2e34-3333-4726-8efe-12579941601c req-5861d910-7b42-4c37-b7f6-3f9605d265f8 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:31.248949 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.compute.server_external_events [req-2c3d2e34-3333-4726-8efe-12579941601c req-5861d910-7b42-4c37-b7f6-3f9605d265f8 service nova] Creating event network-changed:4d656245-ccde-4b1f-a74a-7077e762ec01 for instance a8379d7c-c539-4cb8-9c06-886aff24e725 on hv-cinder-82282 Jun 30 10:41:31.254868 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [req-2c3d2e34-3333-4726-8efe-12579941601c req-5861d910-7b42-4c37-b7f6-3f9605d265f8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038818 Jun 30 10:41:31.255657 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 155/302] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:41:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:41:31.366648 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-f28bc23b-b49e-4827-95de-ce25e605585b tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:31.367471 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-f28bc23b-b49e-4827-95de-ce25e605585b tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] [instance: 68b71cd8-d4e6-4646-acf7-317020683d8c] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:31.374256 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f28bc23b-b49e-4827-95de-ce25e605585b tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:31.374828 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f28bc23b-b49e-4827-95de-ce25e605585b tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:31.375455 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f28bc23b-b49e-4827-95de-ce25e605585b tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:31.375910 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f28bc23b-b49e-4827-95de-ce25e605585b tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:31.380785 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:41:31.530949 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-f28bc23b-b49e-4827-95de-ce25e605585b tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c0ccbf16fe4a399945aa5ad34754b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ed6f6064a4cd88a03cf97ab7abeae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:31.538725 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-f28bc23b-b49e-4827-95de-ce25e605585b tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] 10.222.0.59 "GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c" status: 200 len: 1313 microversion: 2.1 time: 0.176035 Jun 30 10:41:31.539436 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 148/303] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:31 2022] GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:41:31.605871 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-afb87b9c-031a-4c3f-a473-949ff4ce449f tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:31.606570 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-afb87b9c-031a-4c3f-a473-949ff4ce449f tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:31.613374 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-afb87b9c-031a-4c3f-a473-949ff4ce449f tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:31.613834 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-afb87b9c-031a-4c3f-a473-949ff4ce449f tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:31.614598 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-afb87b9c-031a-4c3f-a473-949ff4ce449f tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:31.615034 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-afb87b9c-031a-4c3f-a473-949ff4ce449f tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:31.751174 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-afb87b9c-031a-4c3f-a473-949ff4ce449f tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:31.761932 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-afb87b9c-031a-4c3f-a473-949ff4ce449f tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1520 microversion: 2.1 time: 0.160710 Jun 30 10:41:31.765618 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 156/304] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:31 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:31.849536 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [req-55b4d3a0-8210-4ced-adf4-eea68b625b6c req-0ca569a5-e8af-40df-aed9-755aba1b69b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bc2024c-c05e-4409-a142-e8cf3191a203", "tag": "90e52b50-5114-40c4-a042-20650fd1b094"}]} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:41:31.870086 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-55b4d3a0-8210-4ced-adf4-eea68b625b6c req-0ca569a5-e8af-40df-aed9-755aba1b69b4 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:31.870766 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-55b4d3a0-8210-4ced-adf4-eea68b625b6c req-0ca569a5-e8af-40df-aed9-755aba1b69b4 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:31.884765 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.compute.server_external_events [req-55b4d3a0-8210-4ced-adf4-eea68b625b6c req-0ca569a5-e8af-40df-aed9-755aba1b69b4 service nova] Creating event network-changed:90e52b50-5114-40c4-a042-20650fd1b094 for instance 6bc2024c-c05e-4409-a142-e8cf3191a203 on hv-cinder-82282 Jun 30 10:41:31.889838 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [req-55b4d3a0-8210-4ced-adf4-eea68b625b6c req-0ca569a5-e8af-40df-aed9-755aba1b69b4 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043977 Jun 30 10:41:31.890440 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 149/305] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:41:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:41:32.555116 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-f31e12ab-a5e7-4d31-970b-6abcbcb34867 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:32.555727 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-f31e12ab-a5e7-4d31-970b-6abcbcb34867 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] [instance: 68b71cd8-d4e6-4646-acf7-317020683d8c] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:32.562293 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-f31e12ab-a5e7-4d31-970b-6abcbcb34867 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:32.562740 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-f31e12ab-a5e7-4d31-970b-6abcbcb34867 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:32.563500 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-f31e12ab-a5e7-4d31-970b-6abcbcb34867 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:32.563938 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-f31e12ab-a5e7-4d31-970b-6abcbcb34867 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:32.697737 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-f31e12ab-a5e7-4d31-970b-6abcbcb34867 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c0ccbf16fe4a399945aa5ad34754b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ed6f6064a4cd88a03cf97ab7abeae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:32.706013 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-f31e12ab-a5e7-4d31-970b-6abcbcb34867 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] 10.222.0.59 "GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c" status: 200 len: 1313 microversion: 2.1 time: 0.154638 Jun 30 10:41:32.706595 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 157/306] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:32 2022] GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:32.779734 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-784d528c-9a7f-4229-a1ab-e196ec885e01 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:32.780431 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-784d528c-9a7f-4229-a1ab-e196ec885e01 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:32.787307 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-784d528c-9a7f-4229-a1ab-e196ec885e01 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:32.787759 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-784d528c-9a7f-4229-a1ab-e196ec885e01 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:32.788613 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-784d528c-9a7f-4229-a1ab-e196ec885e01 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:32.789049 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-784d528c-9a7f-4229-a1ab-e196ec885e01 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:32.924441 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-784d528c-9a7f-4229-a1ab-e196ec885e01 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:32.931880 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-784d528c-9a7f-4229-a1ab-e196ec885e01 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1520 microversion: 2.1 time: 0.156355 Jun 30 10:41:32.932446 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 150/307] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:32 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:33.723420 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-b7545bd2-90ac-4a1a-857b-447b29ed5436 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:33.724148 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-b7545bd2-90ac-4a1a-857b-447b29ed5436 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] [instance: 68b71cd8-d4e6-4646-acf7-317020683d8c] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:33.730956 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b7545bd2-90ac-4a1a-857b-447b29ed5436 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:33.731399 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b7545bd2-90ac-4a1a-857b-447b29ed5436 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:33.738061 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b7545bd2-90ac-4a1a-857b-447b29ed5436 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:33.738516 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b7545bd2-90ac-4a1a-857b-447b29ed5436 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:33.894270 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-b7545bd2-90ac-4a1a-857b-447b29ed5436 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c0ccbf16fe4a399945aa5ad34754b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ed6f6064a4cd88a03cf97ab7abeae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:33.901889 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-b7545bd2-90ac-4a1a-857b-447b29ed5436 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] 10.222.0.59 "GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c" status: 200 len: 1313 microversion: 2.1 time: 0.182290 Jun 30 10:41:33.902446 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 158/308] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:33 2022] GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c => generated 1313 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:33.949500 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-87d8d63f-e90c-4c6f-a43b-4c578ec2f62d tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:33.949989 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-87d8d63f-e90c-4c6f-a43b-4c578ec2f62d tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:33.957143 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-87d8d63f-e90c-4c6f-a43b-4c578ec2f62d tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:33.957521 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-87d8d63f-e90c-4c6f-a43b-4c578ec2f62d tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:33.958295 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-87d8d63f-e90c-4c6f-a43b-4c578ec2f62d tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:33.961120 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-87d8d63f-e90c-4c6f-a43b-4c578ec2f62d tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:34.098066 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-87d8d63f-e90c-4c6f-a43b-4c578ec2f62d tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:34.107409 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-87d8d63f-e90c-4c6f-a43b-4c578ec2f62d tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1520 microversion: 2.1 time: 0.161781 Jun 30 10:41:34.108395 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 151/309] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:33 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:34.918873 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-20644416-ccfa-4274-a5dd-4dad491456de tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:34.919617 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-20644416-ccfa-4274-a5dd-4dad491456de tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] [instance: 68b71cd8-d4e6-4646-acf7-317020683d8c] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:34.926654 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-20644416-ccfa-4274-a5dd-4dad491456de tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:34.927330 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-20644416-ccfa-4274-a5dd-4dad491456de tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:34.928292 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-20644416-ccfa-4274-a5dd-4dad491456de tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:34.929216 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-20644416-ccfa-4274-a5dd-4dad491456de tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:35.064369 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-e658db6a-eac3-45bc-b76f-ba4be56adff1 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1726064447", "imageRef": "c473bd04-5a45-4eb7-b6f4-2b5033d4fc1d", "flavorRef": "452", "networks": [{"uuid": "fc8071a8-8a6d-4054-886b-ddb189fb2d83"}]}} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:41:35.134767 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.network.neutron [None req-e658db6a-eac3-45bc-b76f-ba4be56adff1 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] validate_networks() for [('fc8071a8-8a6d-4054-886b-ddb189fb2d83', None, None, None, None, None)] {{(pid=124204) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 10:41:35.210656 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-20644416-ccfa-4274-a5dd-4dad491456de tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c0ccbf16fe4a399945aa5ad34754b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ed6f6064a4cd88a03cf97ab7abeae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:35.222797 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-20644416-ccfa-4274-a5dd-4dad491456de tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] 10.222.0.59 "GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c" status: 200 len: 1313 microversion: 2.1 time: 0.307553 Jun 30 10:41:35.224033 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 159/310] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:34 2022] GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c => generated 1313 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:35.229200 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-50e306be-63e3-4390-b760-013077fa9bd0 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:35.232093 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-50e306be-63e3-4390-b760-013077fa9bd0 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:35.240806 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-50e306be-63e3-4390-b760-013077fa9bd0 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:35.242019 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-50e306be-63e3-4390-b760-013077fa9bd0 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:35.242968 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-50e306be-63e3-4390-b760-013077fa9bd0 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:35.244643 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-50e306be-63e3-4390-b760-013077fa9bd0 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:35.509457 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-50e306be-63e3-4390-b760-013077fa9bd0 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:35.517563 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-50e306be-63e3-4390-b760-013077fa9bd0 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1520 microversion: 2.1 time: 0.292171 Jun 30 10:41:35.518145 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 160/311] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:35 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1520 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:35.685227 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.virt.hardware [None req-e658db6a-eac3-45bc-b76f-ba4be56adff1 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Flavor limits 0:0:0 {{(pid=124204) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 10:41:35.686171 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.virt.hardware [None req-e658db6a-eac3-45bc-b76f-ba4be56adff1 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Image limits 0:0:0 {{(pid=124204) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 10:41:35.686634 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.virt.hardware [None req-e658db6a-eac3-45bc-b76f-ba4be56adff1 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Flavor pref 0:0:0 {{(pid=124204) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 10:41:35.687036 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.virt.hardware [None req-e658db6a-eac3-45bc-b76f-ba4be56adff1 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Image pref 0:0:0 {{(pid=124204) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 10:41:35.687433 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.virt.hardware [None req-e658db6a-eac3-45bc-b76f-ba4be56adff1 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124204) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 10:41:35.696492 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-e658db6a-eac3-45bc-b76f-ba4be56adff1 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:35.697016 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-e658db6a-eac3-45bc-b76f-ba4be56adff1 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:35.697808 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-e658db6a-eac3-45bc-b76f-ba4be56adff1 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:35.698271 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-e658db6a-eac3-45bc-b76f-ba4be56adff1 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:35.715280 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.quota [None req-e658db6a-eac3-45bc-b76f-ba4be56adff1 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Getting quotas for project bd7df7b583a4440ebcf76e5cce3dffc3. Resources: {'instances', 'cores', 'ram'} {{(pid=124204) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 10:41:35.719302 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.quota [None req-e658db6a-eac3-45bc-b76f-ba4be56adff1 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Getting quotas for user 048f9b7d3ad84b439fedd0b80bc6c353 and project bd7df7b583a4440ebcf76e5cce3dffc3. Resources: {'instances', 'cores', 'ram'} {{(pid=124204) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 10:41:35.730508 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-e658db6a-eac3-45bc-b76f-ba4be56adff1 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Going to run 1 instances... {{(pid=124204) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 10:41:35.732769 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-e658db6a-eac3-45bc-b76f-ba4be56adff1 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] [instance: 6385416e-65e3-4edd-b542-1b8b44cde2e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c473bd04-5a45-4eb7-b6f4-2b5033d4fc1d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124204) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 10:41:35.777652 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-e658db6a-eac3-45bc-b76f-ba4be56adff1 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.717086 Jun 30 10:41:35.778350 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 152/312] 10.222.0.59 () {60 vars in 1146 bytes} [Thu Jun 30 10:41:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 30 10:41:35.788863 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-93e42ca4-168f-4337-88d1-92a30624301d tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:35.789470 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-93e42ca4-168f-4337-88d1-92a30624301d tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] [instance: 6385416e-65e3-4edd-b542-1b8b44cde2e2] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:35.843968 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-93e42ca4-168f-4337-88d1-92a30624301d tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048f9b7d3ad84b439fedd0b80bc6c353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7df7b583a4440ebcf76e5cce3dffc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:35.852280 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-93e42ca4-168f-4337-88d1-92a30624301d tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] 10.222.0.59 "GET /compute/v2.1/servers/6385416e-65e3-4edd-b542-1b8b44cde2e2" status: 200 len: 1219 microversion: 2.1 time: 0.067530 Jun 30 10:41:35.853003 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 161/313] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:35 2022] GET /compute/v2.1/servers/6385416e-65e3-4edd-b542-1b8b44cde2e2 => generated 1219 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:36.240908 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-fe4e9264-13b1-474f-a8c2-82f4f6ca5f90 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:36.241435 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-fe4e9264-13b1-474f-a8c2-82f4f6ca5f90 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] [instance: 68b71cd8-d4e6-4646-acf7-317020683d8c] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:36.247608 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-fe4e9264-13b1-474f-a8c2-82f4f6ca5f90 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:36.248808 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-fe4e9264-13b1-474f-a8c2-82f4f6ca5f90 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:36.249569 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-fe4e9264-13b1-474f-a8c2-82f4f6ca5f90 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:36.250005 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-fe4e9264-13b1-474f-a8c2-82f4f6ca5f90 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:36.376695 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-fe4e9264-13b1-474f-a8c2-82f4f6ca5f90 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c0ccbf16fe4a399945aa5ad34754b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ed6f6064a4cd88a03cf97ab7abeae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:36.384206 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-fe4e9264-13b1-474f-a8c2-82f4f6ca5f90 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] 10.222.0.59 "GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c" status: 200 len: 1313 microversion: 2.1 time: 0.147817 Jun 30 10:41:36.384889 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 153/314] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:36 2022] GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:36.534834 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-ccdc6ed8-4a39-4960-a4c0-d3b796d87532 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:36.535458 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-ccdc6ed8-4a39-4960-a4c0-d3b796d87532 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:36.541221 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ccdc6ed8-4a39-4960-a4c0-d3b796d87532 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:36.541660 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ccdc6ed8-4a39-4960-a4c0-d3b796d87532 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:36.542403 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ccdc6ed8-4a39-4960-a4c0-d3b796d87532 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:36.542831 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ccdc6ed8-4a39-4960-a4c0-d3b796d87532 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:36.671601 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-ccdc6ed8-4a39-4960-a4c0-d3b796d87532 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:36.678934 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-ccdc6ed8-4a39-4960-a4c0-d3b796d87532 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1520 microversion: 2.1 time: 0.147874 Jun 30 10:41:36.679495 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 162/315] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:36 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:36.869473 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-3502f245-30c6-4809-b885-9b707482e68b tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:36.870072 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-3502f245-30c6-4809-b885-9b707482e68b tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] [instance: 6385416e-65e3-4edd-b542-1b8b44cde2e2] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:36.876136 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-3502f245-30c6-4809-b885-9b707482e68b tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:36.876605 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-3502f245-30c6-4809-b885-9b707482e68b tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:36.877349 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-3502f245-30c6-4809-b885-9b707482e68b tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:36.877774 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-3502f245-30c6-4809-b885-9b707482e68b tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:36.935907 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-3502f245-30c6-4809-b885-9b707482e68b tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048f9b7d3ad84b439fedd0b80bc6c353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7df7b583a4440ebcf76e5cce3dffc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:36.943492 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-3502f245-30c6-4809-b885-9b707482e68b tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] 10.222.0.59 "GET /compute/v2.1/servers/6385416e-65e3-4edd-b542-1b8b44cde2e2" status: 200 len: 1223 microversion: 2.1 time: 0.077836 Jun 30 10:41:36.944051 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 154/316] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:36 2022] GET /compute/v2.1/servers/6385416e-65e3-4edd-b542-1b8b44cde2e2 => generated 1223 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:41:37.400035 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-d9a4b578-198e-4c9b-9a2e-a2efc95e5c23 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:37.400707 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-d9a4b578-198e-4c9b-9a2e-a2efc95e5c23 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] [instance: 68b71cd8-d4e6-4646-acf7-317020683d8c] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:37.406823 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-d9a4b578-198e-4c9b-9a2e-a2efc95e5c23 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:37.407263 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-d9a4b578-198e-4c9b-9a2e-a2efc95e5c23 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:37.408011 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-d9a4b578-198e-4c9b-9a2e-a2efc95e5c23 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:37.408443 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-d9a4b578-198e-4c9b-9a2e-a2efc95e5c23 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:37.533590 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-d9a4b578-198e-4c9b-9a2e-a2efc95e5c23 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c0ccbf16fe4a399945aa5ad34754b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ed6f6064a4cd88a03cf97ab7abeae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:37.540073 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-d9a4b578-198e-4c9b-9a2e-a2efc95e5c23 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] 10.222.0.59 "GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c" status: 200 len: 1313 microversion: 2.1 time: 0.143874 Jun 30 10:41:37.541555 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 163/317] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:37 2022] GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c => generated 1313 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:37.694952 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-d4959c1a-dfef-4cb8-a3c9-73317bd9451b tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:37.695561 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-d4959c1a-dfef-4cb8-a3c9-73317bd9451b tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:37.702122 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d4959c1a-dfef-4cb8-a3c9-73317bd9451b tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:37.702692 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d4959c1a-dfef-4cb8-a3c9-73317bd9451b tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:37.703435 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d4959c1a-dfef-4cb8-a3c9-73317bd9451b tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:37.703874 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d4959c1a-dfef-4cb8-a3c9-73317bd9451b tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:37.836699 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-d4959c1a-dfef-4cb8-a3c9-73317bd9451b tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:37.845015 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-d4959c1a-dfef-4cb8-a3c9-73317bd9451b tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1520 microversion: 2.1 time: 0.153710 Jun 30 10:41:37.845584 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 155/318] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:37 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:37.961007 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-de03c59d-2460-4bf8-b564-6092f4b2605e tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:37.961618 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-de03c59d-2460-4bf8-b564-6092f4b2605e tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] [instance: 6385416e-65e3-4edd-b542-1b8b44cde2e2] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:37.968118 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-de03c59d-2460-4bf8-b564-6092f4b2605e tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:37.968577 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-de03c59d-2460-4bf8-b564-6092f4b2605e tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:37.969328 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-de03c59d-2460-4bf8-b564-6092f4b2605e tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:37.969746 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-de03c59d-2460-4bf8-b564-6092f4b2605e tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:38.034750 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-de03c59d-2460-4bf8-b564-6092f4b2605e tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048f9b7d3ad84b439fedd0b80bc6c353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7df7b583a4440ebcf76e5cce3dffc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:38.042466 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-de03c59d-2460-4bf8-b564-6092f4b2605e tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] 10.222.0.59 "GET /compute/v2.1/servers/6385416e-65e3-4edd-b542-1b8b44cde2e2" status: 200 len: 1223 microversion: 2.1 time: 0.085727 Jun 30 10:41:38.043024 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 164/319] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:37 2022] GET /compute/v2.1/servers/6385416e-65e3-4edd-b542-1b8b44cde2e2 => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:38.559602 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-3f986d51-ce8f-4d0b-b44f-dde77ef94c78 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:38.561041 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-3f986d51-ce8f-4d0b-b44f-dde77ef94c78 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] [instance: 68b71cd8-d4e6-4646-acf7-317020683d8c] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:38.568647 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-3f986d51-ce8f-4d0b-b44f-dde77ef94c78 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:38.569300 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-3f986d51-ce8f-4d0b-b44f-dde77ef94c78 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:38.570236 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-3f986d51-ce8f-4d0b-b44f-dde77ef94c78 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:38.570836 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-3f986d51-ce8f-4d0b-b44f-dde77ef94c78 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:38.750752 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-3f986d51-ce8f-4d0b-b44f-dde77ef94c78 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c0ccbf16fe4a399945aa5ad34754b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ed6f6064a4cd88a03cf97ab7abeae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:38.759046 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-3f986d51-ce8f-4d0b-b44f-dde77ef94c78 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] 10.222.0.59 "GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c" status: 200 len: 1313 microversion: 2.1 time: 0.204080 Jun 30 10:41:38.759608 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 156/320] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:38 2022] GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c => generated 1313 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:38.861897 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-1d941f7e-abf8-4ab0-b2e6-dc715df8c47e tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:38.862548 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-1d941f7e-abf8-4ab0-b2e6-dc715df8c47e tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:38.868765 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_api:SELECT=100 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:41:38.873493 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-1d941f7e-abf8-4ab0-b2e6-dc715df8c47e tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:38.873941 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-1d941f7e-abf8-4ab0-b2e6-dc715df8c47e tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:38.874698 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-1d941f7e-abf8-4ab0-b2e6-dc715df8c47e tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:38.875126 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-1d941f7e-abf8-4ab0-b2e6-dc715df8c47e tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:38.879415 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_cell1:SELECT=100 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:41:39.009787 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-1d941f7e-abf8-4ab0-b2e6-dc715df8c47e tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:39.017424 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-1d941f7e-abf8-4ab0-b2e6-dc715df8c47e tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1520 microversion: 2.1 time: 0.159393 Jun 30 10:41:39.017990 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 165/321] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:38 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:39.061608 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-5d6501cf-841a-4032-ace8-8944a906c88d tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:39.062187 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-5d6501cf-841a-4032-ace8-8944a906c88d tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] [instance: 6385416e-65e3-4edd-b542-1b8b44cde2e2] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:39.068263 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5d6501cf-841a-4032-ace8-8944a906c88d tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:39.068904 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5d6501cf-841a-4032-ace8-8944a906c88d tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:39.069660 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5d6501cf-841a-4032-ace8-8944a906c88d tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:39.070088 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5d6501cf-841a-4032-ace8-8944a906c88d tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:39.155697 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-5d6501cf-841a-4032-ace8-8944a906c88d tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048f9b7d3ad84b439fedd0b80bc6c353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7df7b583a4440ebcf76e5cce3dffc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:39.165622 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-5d6501cf-841a-4032-ace8-8944a906c88d tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] 10.222.0.59 "GET /compute/v2.1/servers/6385416e-65e3-4edd-b542-1b8b44cde2e2" status: 200 len: 1271 microversion: 2.1 time: 0.108313 Jun 30 10:41:39.166692 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 157/322] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:39 2022] GET /compute/v2.1/servers/6385416e-65e3-4edd-b542-1b8b44cde2e2 => generated 1271 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:39.775253 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-c1ebd948-7f42-4860-ad25-4997b515127f tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:39.775847 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-c1ebd948-7f42-4860-ad25-4997b515127f tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] [instance: 68b71cd8-d4e6-4646-acf7-317020683d8c] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:39.782365 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c1ebd948-7f42-4860-ad25-4997b515127f tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:39.782790 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c1ebd948-7f42-4860-ad25-4997b515127f tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:39.783576 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c1ebd948-7f42-4860-ad25-4997b515127f tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:39.784001 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c1ebd948-7f42-4860-ad25-4997b515127f tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:39.910993 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-c1ebd948-7f42-4860-ad25-4997b515127f tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c0ccbf16fe4a399945aa5ad34754b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ed6f6064a4cd88a03cf97ab7abeae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:39.918338 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-c1ebd948-7f42-4860-ad25-4997b515127f tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] 10.222.0.59 "GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c" status: 200 len: 1313 microversion: 2.1 time: 0.146868 Jun 30 10:41:39.918928 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 166/323] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:39 2022] GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:40.034977 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-6e99d22e-1432-40b7-a3a9-a4bc4cbb9bdc tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:40.035590 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-6e99d22e-1432-40b7-a3a9-a4bc4cbb9bdc tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:40.042495 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6e99d22e-1432-40b7-a3a9-a4bc4cbb9bdc tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:40.042958 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6e99d22e-1432-40b7-a3a9-a4bc4cbb9bdc tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:40.043720 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6e99d22e-1432-40b7-a3a9-a4bc4cbb9bdc tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:40.044154 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6e99d22e-1432-40b7-a3a9-a4bc4cbb9bdc tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:40.185000 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-9b1dffd2-9e1f-4b21-b0db-9fca58bb901f tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:40.185000 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-9b1dffd2-9e1f-4b21-b0db-9fca58bb901f tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] [instance: 6385416e-65e3-4edd-b542-1b8b44cde2e2] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:40.188586 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-6e99d22e-1432-40b7-a3a9-a4bc4cbb9bdc tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:40.191699 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-9b1dffd2-9e1f-4b21-b0db-9fca58bb901f tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:40.192145 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-9b1dffd2-9e1f-4b21-b0db-9fca58bb901f tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:40.192928 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-9b1dffd2-9e1f-4b21-b0db-9fca58bb901f tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:40.193402 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-9b1dffd2-9e1f-4b21-b0db-9fca58bb901f tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:40.197343 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-6e99d22e-1432-40b7-a3a9-a4bc4cbb9bdc tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1520 microversion: 2.1 time: 0.166658 Jun 30 10:41:40.199357 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 158/324] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:40 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:40.329472 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-9b1dffd2-9e1f-4b21-b0db-9fca58bb901f tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048f9b7d3ad84b439fedd0b80bc6c353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7df7b583a4440ebcf76e5cce3dffc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:40.336784 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-9b1dffd2-9e1f-4b21-b0db-9fca58bb901f tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] 10.222.0.59 "GET /compute/v2.1/servers/6385416e-65e3-4edd-b542-1b8b44cde2e2" status: 200 len: 1319 microversion: 2.1 time: 0.156351 Jun 30 10:41:40.337346 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 167/325] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:40 2022] GET /compute/v2.1/servers/6385416e-65e3-4edd-b542-1b8b44cde2e2 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:41:40.934532 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-ee9f8ea1-501b-401b-a0af-e62dae45ec7b tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:40.935134 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-ee9f8ea1-501b-401b-a0af-e62dae45ec7b tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] [instance: 68b71cd8-d4e6-4646-acf7-317020683d8c] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:40.941164 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ee9f8ea1-501b-401b-a0af-e62dae45ec7b tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:40.941601 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ee9f8ea1-501b-401b-a0af-e62dae45ec7b tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:40.942345 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ee9f8ea1-501b-401b-a0af-e62dae45ec7b tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:40.942773 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ee9f8ea1-501b-401b-a0af-e62dae45ec7b tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:41.067377 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-ee9f8ea1-501b-401b-a0af-e62dae45ec7b tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c0ccbf16fe4a399945aa5ad34754b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ed6f6064a4cd88a03cf97ab7abeae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:41.074674 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-ee9f8ea1-501b-401b-a0af-e62dae45ec7b tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] 10.222.0.59 "GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c" status: 200 len: 1313 microversion: 2.1 time: 0.144022 Jun 30 10:41:41.075227 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 159/326] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:40 2022] GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c => generated 1313 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:41.216119 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-d3a819a4-c0d7-48d9-bbde-080f5446f7a7 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:41.216777 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-d3a819a4-c0d7-48d9-bbde-080f5446f7a7 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:41.223422 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-d3a819a4-c0d7-48d9-bbde-080f5446f7a7 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:41.223959 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-d3a819a4-c0d7-48d9-bbde-080f5446f7a7 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:41.224639 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-d3a819a4-c0d7-48d9-bbde-080f5446f7a7 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:41.225077 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-d3a819a4-c0d7-48d9-bbde-080f5446f7a7 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:41.353811 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-974ecdb2-aac5-45c7-8806-2d3c6ce7b77e tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:41.354542 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-974ecdb2-aac5-45c7-8806-2d3c6ce7b77e tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] [instance: 6385416e-65e3-4edd-b542-1b8b44cde2e2] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:41.355567 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-d3a819a4-c0d7-48d9-bbde-080f5446f7a7 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:41.358104 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:41:41.362300 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-974ecdb2-aac5-45c7-8806-2d3c6ce7b77e tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:41.362835 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-974ecdb2-aac5-45c7-8806-2d3c6ce7b77e tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:41.363437 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-d3a819a4-c0d7-48d9-bbde-080f5446f7a7 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1520 microversion: 2.1 time: 0.151104 Jun 30 10:41:41.363780 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-974ecdb2-aac5-45c7-8806-2d3c6ce7b77e tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:41.364013 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 168/327] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:41 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:41.364347 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-974ecdb2-aac5-45c7-8806-2d3c6ce7b77e tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:41.490554 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-974ecdb2-aac5-45c7-8806-2d3c6ce7b77e tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048f9b7d3ad84b439fedd0b80bc6c353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7df7b583a4440ebcf76e5cce3dffc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:41.497890 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-974ecdb2-aac5-45c7-8806-2d3c6ce7b77e tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] 10.222.0.59 "GET /compute/v2.1/servers/6385416e-65e3-4edd-b542-1b8b44cde2e2" status: 200 len: 1319 microversion: 2.1 time: 0.148400 Jun 30 10:41:41.498451 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 160/328] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:41 2022] GET /compute/v2.1/servers/6385416e-65e3-4edd-b542-1b8b44cde2e2 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:41:41.701576 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [req-61933480-6071-4294-ae91-3de37b45ee25 req-09851188-5ef5-41ff-96ee-53812c126363 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68b71cd8-d4e6-4646-acf7-317020683d8c", "name": "network-vif-plugged", "status": "completed", "tag": "ad7f39dc-4189-449d-90a6-f5875e739022"}]} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:41:41.711628 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-61933480-6071-4294-ae91-3de37b45ee25 req-09851188-5ef5-41ff-96ee-53812c126363 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:41.713085 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-61933480-6071-4294-ae91-3de37b45ee25 req-09851188-5ef5-41ff-96ee-53812c126363 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:41.725962 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.compute.server_external_events [req-61933480-6071-4294-ae91-3de37b45ee25 req-09851188-5ef5-41ff-96ee-53812c126363 service nova] Creating event network-vif-plugged:ad7f39dc-4189-449d-90a6-f5875e739022 for instance 68b71cd8-d4e6-4646-acf7-317020683d8c on hv-cinder-82282 Jun 30 10:41:41.731539 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [req-61933480-6071-4294-ae91-3de37b45ee25 req-09851188-5ef5-41ff-96ee-53812c126363 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033675 Jun 30 10:41:41.732520 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 169/329] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:41:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:41:42.092293 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-2e52518d-fcaa-4eae-9ae7-6bb6c6e3367b tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:42.094636 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-2e52518d-fcaa-4eae-9ae7-6bb6c6e3367b tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] [instance: 68b71cd8-d4e6-4646-acf7-317020683d8c] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:42.110467 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-2e52518d-fcaa-4eae-9ae7-6bb6c6e3367b tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:42.111267 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-2e52518d-fcaa-4eae-9ae7-6bb6c6e3367b tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:42.112263 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-2e52518d-fcaa-4eae-9ae7-6bb6c6e3367b tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:42.112887 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-2e52518d-fcaa-4eae-9ae7-6bb6c6e3367b tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:42.262983 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-2e52518d-fcaa-4eae-9ae7-6bb6c6e3367b tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c0ccbf16fe4a399945aa5ad34754b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ed6f6064a4cd88a03cf97ab7abeae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:42.270630 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-2e52518d-fcaa-4eae-9ae7-6bb6c6e3367b tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] 10.222.0.59 "GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c" status: 200 len: 1313 microversion: 2.1 time: 0.183230 Jun 30 10:41:42.280771 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 161/330] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:42 2022] GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c => generated 1313 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:42.381094 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-762d671b-ef77-468a-befa-e60cdc1d225b tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:42.381803 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-762d671b-ef77-468a-befa-e60cdc1d225b tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:42.388440 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-762d671b-ef77-468a-befa-e60cdc1d225b tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:42.388902 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-762d671b-ef77-468a-befa-e60cdc1d225b tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:42.389742 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-762d671b-ef77-468a-befa-e60cdc1d225b tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:42.390272 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-762d671b-ef77-468a-befa-e60cdc1d225b tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:42.515532 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-03cbb2a3-9f8c-4e3c-8e23-928e37fc2b5b tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:42.516550 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-03cbb2a3-9f8c-4e3c-8e23-928e37fc2b5b tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] [instance: 6385416e-65e3-4edd-b542-1b8b44cde2e2] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:42.523544 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-03cbb2a3-9f8c-4e3c-8e23-928e37fc2b5b tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:42.524289 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-03cbb2a3-9f8c-4e3c-8e23-928e37fc2b5b tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:42.525434 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-03cbb2a3-9f8c-4e3c-8e23-928e37fc2b5b tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:42.526195 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-03cbb2a3-9f8c-4e3c-8e23-928e37fc2b5b tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:42.532271 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-762d671b-ef77-468a-befa-e60cdc1d225b tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:42.541697 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-762d671b-ef77-468a-befa-e60cdc1d225b tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1520 microversion: 2.1 time: 0.164732 Jun 30 10:41:42.542516 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 170/331] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:42 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:42.669149 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-03cbb2a3-9f8c-4e3c-8e23-928e37fc2b5b tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048f9b7d3ad84b439fedd0b80bc6c353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7df7b583a4440ebcf76e5cce3dffc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:42.676983 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-03cbb2a3-9f8c-4e3c-8e23-928e37fc2b5b tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] 10.222.0.59 "GET /compute/v2.1/servers/6385416e-65e3-4edd-b542-1b8b44cde2e2" status: 200 len: 1319 microversion: 2.1 time: 0.165629 Jun 30 10:41:42.677563 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 162/332] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:42 2022] GET /compute/v2.1/servers/6385416e-65e3-4edd-b542-1b8b44cde2e2 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:42.754711 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [req-7086f23a-bd2a-473b-829b-cf2a118da6d3 req-70c09d1f-eb42-425e-b2e9-100ca7effea9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6385416e-65e3-4edd-b542-1b8b44cde2e2", "tag": "53ed2a07-49c6-458f-a5ea-d7c5dfc5129c"}]} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:41:42.762559 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-7086f23a-bd2a-473b-829b-cf2a118da6d3 req-70c09d1f-eb42-425e-b2e9-100ca7effea9 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:42.762990 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-7086f23a-bd2a-473b-829b-cf2a118da6d3 req-70c09d1f-eb42-425e-b2e9-100ca7effea9 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:42.774278 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.compute.server_external_events [req-7086f23a-bd2a-473b-829b-cf2a118da6d3 req-70c09d1f-eb42-425e-b2e9-100ca7effea9 service nova] Creating event network-changed:53ed2a07-49c6-458f-a5ea-d7c5dfc5129c for instance 6385416e-65e3-4edd-b542-1b8b44cde2e2 on hv-cinder-82282 Jun 30 10:41:42.778904 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [req-7086f23a-bd2a-473b-829b-cf2a118da6d3 req-70c09d1f-eb42-425e-b2e9-100ca7effea9 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027872 Jun 30 10:41:42.779495 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 171/333] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:41:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:41:43.287086 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-58197b5c-41b1-4ac9-b0bf-d819bb7bc820 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:43.287787 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-58197b5c-41b1-4ac9-b0bf-d819bb7bc820 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] [instance: 68b71cd8-d4e6-4646-acf7-317020683d8c] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:43.294505 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-58197b5c-41b1-4ac9-b0bf-d819bb7bc820 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:43.294957 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-58197b5c-41b1-4ac9-b0bf-d819bb7bc820 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:43.295750 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-58197b5c-41b1-4ac9-b0bf-d819bb7bc820 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:43.296188 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-58197b5c-41b1-4ac9-b0bf-d819bb7bc820 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:43.430720 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-58197b5c-41b1-4ac9-b0bf-d819bb7bc820 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c0ccbf16fe4a399945aa5ad34754b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ed6f6064a4cd88a03cf97ab7abeae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:43.438647 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-58197b5c-41b1-4ac9-b0bf-d819bb7bc820 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] 10.222.0.59 "GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c" status: 200 len: 1313 microversion: 2.1 time: 0.155428 Jun 30 10:41:43.439225 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 163/334] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:43 2022] GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:43.559380 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-2a1c082d-b6a8-458b-a6c3-1f52f68aa576 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:43.560065 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-2a1c082d-b6a8-458b-a6c3-1f52f68aa576 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:43.566929 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-2a1c082d-b6a8-458b-a6c3-1f52f68aa576 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:43.567350 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-2a1c082d-b6a8-458b-a6c3-1f52f68aa576 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:43.568099 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-2a1c082d-b6a8-458b-a6c3-1f52f68aa576 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:43.568551 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-2a1c082d-b6a8-458b-a6c3-1f52f68aa576 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:43.694725 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-22950157-e46b-4772-a307-f64a2e8bd0a3 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:43.695288 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-22950157-e46b-4772-a307-f64a2e8bd0a3 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] [instance: 6385416e-65e3-4edd-b542-1b8b44cde2e2] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:43.701313 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-22950157-e46b-4772-a307-f64a2e8bd0a3 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:43.702128 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-22950157-e46b-4772-a307-f64a2e8bd0a3 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:43.703095 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-22950157-e46b-4772-a307-f64a2e8bd0a3 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:43.703706 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-22950157-e46b-4772-a307-f64a2e8bd0a3 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:43.758240 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-2a1c082d-b6a8-458b-a6c3-1f52f68aa576 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:43.766063 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-2a1c082d-b6a8-458b-a6c3-1f52f68aa576 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1520 microversion: 2.1 time: 0.210641 Jun 30 10:41:43.766890 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 172/335] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:43 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1520 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:43.892802 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-22950157-e46b-4772-a307-f64a2e8bd0a3 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048f9b7d3ad84b439fedd0b80bc6c353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7df7b583a4440ebcf76e5cce3dffc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:43.902061 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-22950157-e46b-4772-a307-f64a2e8bd0a3 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] 10.222.0.59 "GET /compute/v2.1/servers/6385416e-65e3-4edd-b542-1b8b44cde2e2" status: 200 len: 1319 microversion: 2.1 time: 0.211279 Jun 30 10:41:43.902972 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 164/336] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:43 2022] GET /compute/v2.1/servers/6385416e-65e3-4edd-b542-1b8b44cde2e2 => generated 1319 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:41:44.005031 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-0380758d-58e7-4eb8-b956-fe5ee236eda0 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:44.005526 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-0380758d-58e7-4eb8-b956-fe5ee236eda0 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] [instance: 5c8d5bc5-4671-4189-94e0-1442e872fc2d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:44.011856 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0380758d-58e7-4eb8-b956-fe5ee236eda0 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:44.012626 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0380758d-58e7-4eb8-b956-fe5ee236eda0 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:44.013604 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0380758d-58e7-4eb8-b956-fe5ee236eda0 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:44.014244 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0380758d-58e7-4eb8-b956-fe5ee236eda0 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:44.040071 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-0380758d-58e7-4eb8-b956-fe5ee236eda0 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] [instance: 5c8d5bc5-4671-4189-94e0-1442e872fc2d] Going to try to terminate instance {{(pid=124203) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 10:41:44.127145 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-0380758d-58e7-4eb8-b956-fe5ee236eda0 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] 10.222.0.59 "DELETE /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d" status: 204 len: 0 microversion: 2.1 time: 0.125748 Jun 30 10:41:44.127736 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 173/337] 10.222.0.59 () {58 vars in 1238 bytes} [Thu Jun 30 10:41:43 2022] DELETE /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 10:41:44.136134 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-f84a2afa-742f-41c4-9417-ed9d4061bd33 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:44.136779 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-f84a2afa-742f-41c4-9417-ed9d4061bd33 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] [instance: 5c8d5bc5-4671-4189-94e0-1442e872fc2d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:44.143243 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f84a2afa-742f-41c4-9417-ed9d4061bd33 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:44.143684 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f84a2afa-742f-41c4-9417-ed9d4061bd33 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:44.144442 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f84a2afa-742f-41c4-9417-ed9d4061bd33 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:44.144903 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f84a2afa-742f-41c4-9417-ed9d4061bd33 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:44.274611 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-f84a2afa-742f-41c4-9417-ed9d4061bd33 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad75a8b887a4a40accb49603f03c8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d27fbbe7475782fe2202e34aec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:44.283519 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-f84a2afa-742f-41c4-9417-ed9d4061bd33 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] 10.222.0.59 "GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d" status: 200 len: 1553 microversion: 2.1 time: 0.151674 Jun 30 10:41:44.284157 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 165/338] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:44 2022] GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:44.464366 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-3ca7d1dc-a896-4a74-b118-c0d1c3df2458 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:44.465193 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-3ca7d1dc-a896-4a74-b118-c0d1c3df2458 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] [instance: 68b71cd8-d4e6-4646-acf7-317020683d8c] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:44.477669 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-3ca7d1dc-a896-4a74-b118-c0d1c3df2458 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:44.478113 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-3ca7d1dc-a896-4a74-b118-c0d1c3df2458 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:44.478907 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-3ca7d1dc-a896-4a74-b118-c0d1c3df2458 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:44.479342 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-3ca7d1dc-a896-4a74-b118-c0d1c3df2458 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:44.621796 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-3ca7d1dc-a896-4a74-b118-c0d1c3df2458 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c0ccbf16fe4a399945aa5ad34754b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ed6f6064a4cd88a03cf97ab7abeae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:44.629877 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-3ca7d1dc-a896-4a74-b118-c0d1c3df2458 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] 10.222.0.59 "GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c" status: 200 len: 1313 microversion: 2.1 time: 0.178365 Jun 30 10:41:44.630457 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 174/339] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:44 2022] GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:44.783589 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-b4341d83-e2d6-4a34-947b-c47582e29f72 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:44.784207 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-b4341d83-e2d6-4a34-947b-c47582e29f72 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:44.791394 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-b4341d83-e2d6-4a34-947b-c47582e29f72 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:44.791840 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-b4341d83-e2d6-4a34-947b-c47582e29f72 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:44.792658 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-b4341d83-e2d6-4a34-947b-c47582e29f72 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:44.793104 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-b4341d83-e2d6-4a34-947b-c47582e29f72 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:44.797181 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_cell1:SELECT=100 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:41:44.919246 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-c0f3f400-c4ff-4b4f-8cd1-6947dd489563 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:44.920207 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-c0f3f400-c4ff-4b4f-8cd1-6947dd489563 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] [instance: 6385416e-65e3-4edd-b542-1b8b44cde2e2] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:44.926131 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c0f3f400-c4ff-4b4f-8cd1-6947dd489563 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:44.926570 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c0f3f400-c4ff-4b4f-8cd1-6947dd489563 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:44.927327 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c0f3f400-c4ff-4b4f-8cd1-6947dd489563 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:44.927757 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c0f3f400-c4ff-4b4f-8cd1-6947dd489563 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:44.962913 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-b4341d83-e2d6-4a34-947b-c47582e29f72 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:44.971720 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-b4341d83-e2d6-4a34-947b-c47582e29f72 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1520 microversion: 2.1 time: 0.192734 Jun 30 10:41:44.972375 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 166/340] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:44 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1520 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:45.062930 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-c0f3f400-c4ff-4b4f-8cd1-6947dd489563 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048f9b7d3ad84b439fedd0b80bc6c353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7df7b583a4440ebcf76e5cce3dffc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:45.070109 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-c0f3f400-c4ff-4b4f-8cd1-6947dd489563 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] 10.222.0.59 "GET /compute/v2.1/servers/6385416e-65e3-4edd-b542-1b8b44cde2e2" status: 200 len: 1319 microversion: 2.1 time: 0.154794 Jun 30 10:41:45.070671 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 175/341] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:44 2022] GET /compute/v2.1/servers/6385416e-65e3-4edd-b542-1b8b44cde2e2 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:41:45.301487 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-f7e7c7fa-6631-4f8e-81ad-f2adadc04c7e tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:45.302317 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-f7e7c7fa-6631-4f8e-81ad-f2adadc04c7e tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] [instance: 5c8d5bc5-4671-4189-94e0-1442e872fc2d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:45.308394 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f7e7c7fa-6631-4f8e-81ad-f2adadc04c7e tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:45.308874 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f7e7c7fa-6631-4f8e-81ad-f2adadc04c7e tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:45.309631 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f7e7c7fa-6631-4f8e-81ad-f2adadc04c7e tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:45.310067 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f7e7c7fa-6631-4f8e-81ad-f2adadc04c7e tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:45.434988 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-f7e7c7fa-6631-4f8e-81ad-f2adadc04c7e tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad75a8b887a4a40accb49603f03c8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d27fbbe7475782fe2202e34aec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:45.443344 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-f7e7c7fa-6631-4f8e-81ad-f2adadc04c7e tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] 10.222.0.59 "GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d" status: 200 len: 1553 microversion: 2.1 time: 0.146451 Jun 30 10:41:45.443909 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 167/342] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:45 2022] GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d => generated 1553 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:45.646307 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-0d2507a9-42a1-42f2-9b45-61c9af005727 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:45.646909 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-0d2507a9-42a1-42f2-9b45-61c9af005727 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] [instance: 68b71cd8-d4e6-4646-acf7-317020683d8c] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:45.652896 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0d2507a9-42a1-42f2-9b45-61c9af005727 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:45.653337 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0d2507a9-42a1-42f2-9b45-61c9af005727 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:45.654093 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0d2507a9-42a1-42f2-9b45-61c9af005727 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:45.654523 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0d2507a9-42a1-42f2-9b45-61c9af005727 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:45.848716 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_cell0:SELECT=2 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:41:45.939363 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-0d2507a9-42a1-42f2-9b45-61c9af005727 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c0ccbf16fe4a399945aa5ad34754b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ed6f6064a4cd88a03cf97ab7abeae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:45.946698 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-0d2507a9-42a1-42f2-9b45-61c9af005727 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] 10.222.0.59 "GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c" status: 200 len: 1313 microversion: 2.1 time: 0.304122 Jun 30 10:41:45.947250 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 176/343] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:45 2022] GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c => generated 1313 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:45.990802 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-cd649b7a-2495-4c2c-a543-5a3ed6e0bdad tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:45.991532 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-cd649b7a-2495-4c2c-a543-5a3ed6e0bdad tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:45.993517 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_cell0:SELECT=2 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:41:45.994224 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_cell0:SELECT=6 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:41:46.000836 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-cd649b7a-2495-4c2c-a543-5a3ed6e0bdad tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:46.001520 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-cd649b7a-2495-4c2c-a543-5a3ed6e0bdad tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:46.002301 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-cd649b7a-2495-4c2c-a543-5a3ed6e0bdad tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:46.002795 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-cd649b7a-2495-4c2c-a543-5a3ed6e0bdad tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:46.087230 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-f5392877-f5df-4c9d-aa52-b3e69e02b1f9 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:46.087901 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-f5392877-f5df-4c9d-aa52-b3e69e02b1f9 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] [instance: 6385416e-65e3-4edd-b542-1b8b44cde2e2] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:46.094344 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-f5392877-f5df-4c9d-aa52-b3e69e02b1f9 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:46.095299 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-f5392877-f5df-4c9d-aa52-b3e69e02b1f9 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:46.096185 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-f5392877-f5df-4c9d-aa52-b3e69e02b1f9 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:46.096661 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-f5392877-f5df-4c9d-aa52-b3e69e02b1f9 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:46.155007 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-cd649b7a-2495-4c2c-a543-5a3ed6e0bdad tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:46.163113 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-cd649b7a-2495-4c2c-a543-5a3ed6e0bdad tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1520 microversion: 2.1 time: 0.176402 Jun 30 10:41:46.163682 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 168/344] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:45 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:46.238721 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-f5392877-f5df-4c9d-aa52-b3e69e02b1f9 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048f9b7d3ad84b439fedd0b80bc6c353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7df7b583a4440ebcf76e5cce3dffc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:46.250026 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-f5392877-f5df-4c9d-aa52-b3e69e02b1f9 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] 10.222.0.59 "GET /compute/v2.1/servers/6385416e-65e3-4edd-b542-1b8b44cde2e2" status: 200 len: 1319 microversion: 2.1 time: 0.166481 Jun 30 10:41:46.251724 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 177/345] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:46 2022] GET /compute/v2.1/servers/6385416e-65e3-4edd-b542-1b8b44cde2e2 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:41:46.461014 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-ccb1614f-b329-44a0-8ee5-210ee35bed8d tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:46.461619 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-ccb1614f-b329-44a0-8ee5-210ee35bed8d tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] [instance: 5c8d5bc5-4671-4189-94e0-1442e872fc2d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:46.467552 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ccb1614f-b329-44a0-8ee5-210ee35bed8d tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:46.467994 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ccb1614f-b329-44a0-8ee5-210ee35bed8d tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:46.468771 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ccb1614f-b329-44a0-8ee5-210ee35bed8d tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:46.469202 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ccb1614f-b329-44a0-8ee5-210ee35bed8d tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:46.602707 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-ccb1614f-b329-44a0-8ee5-210ee35bed8d tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad75a8b887a4a40accb49603f03c8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d27fbbe7475782fe2202e34aec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:46.610955 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-ccb1614f-b329-44a0-8ee5-210ee35bed8d tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] 10.222.0.59 "GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d" status: 200 len: 1553 microversion: 2.1 time: 0.153671 Jun 30 10:41:46.611542 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 169/346] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:46 2022] GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:46.963059 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-f78944d8-66d3-4b81-9f2e-3e8a061a3622 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:46.963669 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-f78944d8-66d3-4b81-9f2e-3e8a061a3622 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] [instance: 68b71cd8-d4e6-4646-acf7-317020683d8c] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:46.969765 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-f78944d8-66d3-4b81-9f2e-3e8a061a3622 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:46.970209 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-f78944d8-66d3-4b81-9f2e-3e8a061a3622 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:46.970969 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-f78944d8-66d3-4b81-9f2e-3e8a061a3622 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:46.971400 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-f78944d8-66d3-4b81-9f2e-3e8a061a3622 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:47.098586 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-f78944d8-66d3-4b81-9f2e-3e8a061a3622 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c0ccbf16fe4a399945aa5ad34754b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ed6f6064a4cd88a03cf97ab7abeae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:47.106222 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-f78944d8-66d3-4b81-9f2e-3e8a061a3622 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] 10.222.0.59 "GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c" status: 200 len: 1313 microversion: 2.1 time: 0.147003 Jun 30 10:41:47.106776 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 178/347] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:46 2022] GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:47.179544 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-11f6ad06-089d-4e96-a91d-49e1bff6b9cd tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:47.180154 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-11f6ad06-089d-4e96-a91d-49e1bff6b9cd tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:47.187242 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-11f6ad06-089d-4e96-a91d-49e1bff6b9cd tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:47.188016 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-11f6ad06-089d-4e96-a91d-49e1bff6b9cd tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:47.189710 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-11f6ad06-089d-4e96-a91d-49e1bff6b9cd tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:47.190154 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-11f6ad06-089d-4e96-a91d-49e1bff6b9cd tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:47.270882 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-ffa5cb3b-22f0-4926-a637-6416cadef2ae tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:47.271546 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-ffa5cb3b-22f0-4926-a637-6416cadef2ae tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] [instance: 6385416e-65e3-4edd-b542-1b8b44cde2e2] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:47.277571 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ffa5cb3b-22f0-4926-a637-6416cadef2ae tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:47.278013 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ffa5cb3b-22f0-4926-a637-6416cadef2ae tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:47.278766 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ffa5cb3b-22f0-4926-a637-6416cadef2ae tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:47.279198 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ffa5cb3b-22f0-4926-a637-6416cadef2ae tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:47.514372 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-11f6ad06-089d-4e96-a91d-49e1bff6b9cd tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:47.521786 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-11f6ad06-089d-4e96-a91d-49e1bff6b9cd tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1520 microversion: 2.1 time: 0.346097 Jun 30 10:41:47.522354 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 170/348] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:47 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1520 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:47.596132 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-ffa5cb3b-22f0-4926-a637-6416cadef2ae tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048f9b7d3ad84b439fedd0b80bc6c353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7df7b583a4440ebcf76e5cce3dffc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:47.603522 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-ffa5cb3b-22f0-4926-a637-6416cadef2ae tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] 10.222.0.59 "GET /compute/v2.1/servers/6385416e-65e3-4edd-b542-1b8b44cde2e2" status: 200 len: 1319 microversion: 2.1 time: 0.336766 Jun 30 10:41:47.604081 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 179/349] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:47 2022] GET /compute/v2.1/servers/6385416e-65e3-4edd-b542-1b8b44cde2e2 => generated 1319 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:47.626941 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-6b945dcc-7eff-4fb2-82fa-d87a0b2c348e tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:47.627540 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-6b945dcc-7eff-4fb2-82fa-d87a0b2c348e tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] [instance: 5c8d5bc5-4671-4189-94e0-1442e872fc2d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:47.633444 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6b945dcc-7eff-4fb2-82fa-d87a0b2c348e tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:47.633879 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6b945dcc-7eff-4fb2-82fa-d87a0b2c348e tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:47.634624 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6b945dcc-7eff-4fb2-82fa-d87a0b2c348e tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:47.635053 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6b945dcc-7eff-4fb2-82fa-d87a0b2c348e tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:47.897387 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-6b945dcc-7eff-4fb2-82fa-d87a0b2c348e tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad75a8b887a4a40accb49603f03c8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d27fbbe7475782fe2202e34aec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:47.906417 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-6b945dcc-7eff-4fb2-82fa-d87a0b2c348e tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] 10.222.0.59 "GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d" status: 200 len: 1553 microversion: 2.1 time: 0.283240 Jun 30 10:41:47.906996 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 171/350] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:47 2022] GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d => generated 1553 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:48.124669 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-7afcad16-bb70-429e-aedc-8e1b670dc7d7 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:48.125195 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-7afcad16-bb70-429e-aedc-8e1b670dc7d7 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] [instance: 68b71cd8-d4e6-4646-acf7-317020683d8c] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:48.131145 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-7afcad16-bb70-429e-aedc-8e1b670dc7d7 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:48.131587 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-7afcad16-bb70-429e-aedc-8e1b670dc7d7 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:48.132342 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-7afcad16-bb70-429e-aedc-8e1b670dc7d7 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:48.132800 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-7afcad16-bb70-429e-aedc-8e1b670dc7d7 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:48.263343 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-7afcad16-bb70-429e-aedc-8e1b670dc7d7 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c0ccbf16fe4a399945aa5ad34754b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ed6f6064a4cd88a03cf97ab7abeae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:48.271528 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-7afcad16-bb70-429e-aedc-8e1b670dc7d7 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] 10.222.0.59 "GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c" status: 200 len: 1313 microversion: 2.1 time: 0.150678 Jun 30 10:41:48.272360 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 180/351] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:48 2022] GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:48.538516 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-a68b9eca-654f-48ce-bb2c-dbb52dbe73eb tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:48.539119 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-a68b9eca-654f-48ce-bb2c-dbb52dbe73eb tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:48.545734 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a68b9eca-654f-48ce-bb2c-dbb52dbe73eb tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:48.546233 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a68b9eca-654f-48ce-bb2c-dbb52dbe73eb tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:48.547017 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a68b9eca-654f-48ce-bb2c-dbb52dbe73eb tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:48.547448 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a68b9eca-654f-48ce-bb2c-dbb52dbe73eb tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:48.621368 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-4339eb83-d2cb-435b-a290-452945d8fcaa tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:48.621978 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-4339eb83-d2cb-435b-a290-452945d8fcaa tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] [instance: 6385416e-65e3-4edd-b542-1b8b44cde2e2] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:48.628496 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-4339eb83-d2cb-435b-a290-452945d8fcaa tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:48.629004 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-4339eb83-d2cb-435b-a290-452945d8fcaa tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:48.629771 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-4339eb83-d2cb-435b-a290-452945d8fcaa tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:48.630205 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-4339eb83-d2cb-435b-a290-452945d8fcaa tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:48.649883 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:41:48.707384 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-a68b9eca-654f-48ce-bb2c-dbb52dbe73eb tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:48.714792 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-a68b9eca-654f-48ce-bb2c-dbb52dbe73eb tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1520 microversion: 2.1 time: 0.180107 Jun 30 10:41:48.715348 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 172/352] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:48 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:48.771756 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-4339eb83-d2cb-435b-a290-452945d8fcaa tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048f9b7d3ad84b439fedd0b80bc6c353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7df7b583a4440ebcf76e5cce3dffc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:48.780104 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-4339eb83-d2cb-435b-a290-452945d8fcaa tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] 10.222.0.59 "GET /compute/v2.1/servers/6385416e-65e3-4edd-b542-1b8b44cde2e2" status: 200 len: 1319 microversion: 2.1 time: 0.162645 Jun 30 10:41:48.780920 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 181/353] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:48 2022] GET /compute/v2.1/servers/6385416e-65e3-4edd-b542-1b8b44cde2e2 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:48.924174 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-468f812a-9a7a-483f-b958-4fd52b453c3d tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:48.924806 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-468f812a-9a7a-483f-b958-4fd52b453c3d tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] [instance: 5c8d5bc5-4671-4189-94e0-1442e872fc2d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:48.930816 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-468f812a-9a7a-483f-b958-4fd52b453c3d tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:48.931264 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-468f812a-9a7a-483f-b958-4fd52b453c3d tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:48.932022 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-468f812a-9a7a-483f-b958-4fd52b453c3d tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:48.932459 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-468f812a-9a7a-483f-b958-4fd52b453c3d tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:49.063349 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-468f812a-9a7a-483f-b958-4fd52b453c3d tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad75a8b887a4a40accb49603f03c8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d27fbbe7475782fe2202e34aec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:49.071257 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-468f812a-9a7a-483f-b958-4fd52b453c3d tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] 10.222.0.59 "GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d" status: 200 len: 1553 microversion: 2.1 time: 0.151573 Jun 30 10:41:49.071812 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 173/354] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:48 2022] GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:49.289383 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-bedc4149-f42e-4db3-8d63-fb45da3c9d69 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:49.289983 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-bedc4149-f42e-4db3-8d63-fb45da3c9d69 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] [instance: 68b71cd8-d4e6-4646-acf7-317020683d8c] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:49.296138 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-bedc4149-f42e-4db3-8d63-fb45da3c9d69 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:49.296620 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-bedc4149-f42e-4db3-8d63-fb45da3c9d69 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:49.297399 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-bedc4149-f42e-4db3-8d63-fb45da3c9d69 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:49.298677 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-bedc4149-f42e-4db3-8d63-fb45da3c9d69 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:49.433065 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-bedc4149-f42e-4db3-8d63-fb45da3c9d69 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c0ccbf16fe4a399945aa5ad34754b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ed6f6064a4cd88a03cf97ab7abeae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:49.440478 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-bedc4149-f42e-4db3-8d63-fb45da3c9d69 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] 10.222.0.59 "GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c" status: 200 len: 1313 microversion: 2.1 time: 0.154997 Jun 30 10:41:49.441058 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 182/355] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:49 2022] GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:49.731204 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-ed612757-cf2e-4a90-b4ab-3fd4e8b84184 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:49.731819 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-ed612757-cf2e-4a90-b4ab-3fd4e8b84184 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:49.738619 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ed612757-cf2e-4a90-b4ab-3fd4e8b84184 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:49.739051 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ed612757-cf2e-4a90-b4ab-3fd4e8b84184 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:49.739810 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ed612757-cf2e-4a90-b4ab-3fd4e8b84184 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:49.740245 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ed612757-cf2e-4a90-b4ab-3fd4e8b84184 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:49.796687 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-894c1afd-deb6-4c76-a793-686b0adf860a tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:49.797288 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-894c1afd-deb6-4c76-a793-686b0adf860a tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] [instance: 6385416e-65e3-4edd-b542-1b8b44cde2e2] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:49.803299 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-894c1afd-deb6-4c76-a793-686b0adf860a tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:49.803737 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-894c1afd-deb6-4c76-a793-686b0adf860a tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:49.804492 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-894c1afd-deb6-4c76-a793-686b0adf860a tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:49.804967 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-894c1afd-deb6-4c76-a793-686b0adf860a tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:49.916583 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-ed612757-cf2e-4a90-b4ab-3fd4e8b84184 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:49.924713 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-ed612757-cf2e-4a90-b4ab-3fd4e8b84184 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1520 microversion: 2.1 time: 0.197796 Jun 30 10:41:49.925499 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 174/356] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:49 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1520 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:49.959430 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-894c1afd-deb6-4c76-a793-686b0adf860a tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048f9b7d3ad84b439fedd0b80bc6c353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7df7b583a4440ebcf76e5cce3dffc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:49.966999 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-894c1afd-deb6-4c76-a793-686b0adf860a tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] 10.222.0.59 "GET /compute/v2.1/servers/6385416e-65e3-4edd-b542-1b8b44cde2e2" status: 200 len: 1319 microversion: 2.1 time: 0.174216 Jun 30 10:41:49.967555 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 183/357] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:49 2022] GET /compute/v2.1/servers/6385416e-65e3-4edd-b542-1b8b44cde2e2 => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:41:50.089100 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-88b380aa-bd38-4d45-b465-7aa533ab783d tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:50.089876 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-88b380aa-bd38-4d45-b465-7aa533ab783d tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] [instance: 5c8d5bc5-4671-4189-94e0-1442e872fc2d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:50.096619 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-88b380aa-bd38-4d45-b465-7aa533ab783d tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:50.097070 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-88b380aa-bd38-4d45-b465-7aa533ab783d tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:50.097834 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-88b380aa-bd38-4d45-b465-7aa533ab783d tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:50.098271 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-88b380aa-bd38-4d45-b465-7aa533ab783d tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:50.232997 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-88b380aa-bd38-4d45-b465-7aa533ab783d tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad75a8b887a4a40accb49603f03c8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d27fbbe7475782fe2202e34aec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:50.248566 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-88b380aa-bd38-4d45-b465-7aa533ab783d tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] 10.222.0.59 "GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d" status: 200 len: 1553 microversion: 2.1 time: 0.163694 Jun 30 10:41:50.249153 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 175/358] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:50 2022] GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d => generated 1553 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:41:50.457244 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-a507c466-ce19-4ee1-9c90-05e5be46e5d8 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:50.458736 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-a507c466-ce19-4ee1-9c90-05e5be46e5d8 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] [instance: 68b71cd8-d4e6-4646-acf7-317020683d8c] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:50.465543 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a507c466-ce19-4ee1-9c90-05e5be46e5d8 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:50.465995 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a507c466-ce19-4ee1-9c90-05e5be46e5d8 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:50.466770 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a507c466-ce19-4ee1-9c90-05e5be46e5d8 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:50.467380 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a507c466-ce19-4ee1-9c90-05e5be46e5d8 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:50.600386 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-a507c466-ce19-4ee1-9c90-05e5be46e5d8 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c0ccbf16fe4a399945aa5ad34754b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ed6f6064a4cd88a03cf97ab7abeae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:50.608029 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-a507c466-ce19-4ee1-9c90-05e5be46e5d8 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] 10.222.0.59 "GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c" status: 200 len: 1496 microversion: 2.1 time: 0.154791 Jun 30 10:41:50.608602 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 184/359] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:50 2022] GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c => generated 1496 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:50.941155 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-5a1fe370-c45b-46c9-9534-7c7ec908ba15 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:50.941802 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-5a1fe370-c45b-46c9-9534-7c7ec908ba15 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:50.948081 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5a1fe370-c45b-46c9-9534-7c7ec908ba15 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:50.948654 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5a1fe370-c45b-46c9-9534-7c7ec908ba15 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:50.949461 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5a1fe370-c45b-46c9-9534-7c7ec908ba15 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:50.949901 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5a1fe370-c45b-46c9-9534-7c7ec908ba15 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:50.983864 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-10f36270-fb8a-49ef-9107-2fbdc30245a4 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:50.984792 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-10f36270-fb8a-49ef-9107-2fbdc30245a4 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] [instance: 6385416e-65e3-4edd-b542-1b8b44cde2e2] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:50.990785 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-10f36270-fb8a-49ef-9107-2fbdc30245a4 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:50.991306 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-10f36270-fb8a-49ef-9107-2fbdc30245a4 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:50.992166 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-10f36270-fb8a-49ef-9107-2fbdc30245a4 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:50.992704 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-10f36270-fb8a-49ef-9107-2fbdc30245a4 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:51.141187 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-5a1fe370-c45b-46c9-9534-7c7ec908ba15 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:51.149138 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-5a1fe370-c45b-46c9-9534-7c7ec908ba15 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1520 microversion: 2.1 time: 0.211784 Jun 30 10:41:51.149704 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 176/360] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:50 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1520 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:41:51.154050 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-aa592474-479a-4f0c-b2c9-8b543eb779ef tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:51.154538 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-aa592474-479a-4f0c-b2c9-8b543eb779ef tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] [instance: 68b71cd8-d4e6-4646-acf7-317020683d8c] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:51.160776 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-aa592474-479a-4f0c-b2c9-8b543eb779ef tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:51.161217 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-aa592474-479a-4f0c-b2c9-8b543eb779ef tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:51.161977 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-aa592474-479a-4f0c-b2c9-8b543eb779ef tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:51.162407 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-aa592474-479a-4f0c-b2c9-8b543eb779ef tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:51.163372 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-10f36270-fb8a-49ef-9107-2fbdc30245a4 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048f9b7d3ad84b439fedd0b80bc6c353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7df7b583a4440ebcf76e5cce3dffc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:51.171121 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-10f36270-fb8a-49ef-9107-2fbdc30245a4 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] 10.222.0.59 "GET /compute/v2.1/servers/6385416e-65e3-4edd-b542-1b8b44cde2e2" status: 200 len: 1319 microversion: 2.1 time: 0.191256 Jun 30 10:41:51.171648 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 185/361] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:50 2022] GET /compute/v2.1/servers/6385416e-65e3-4edd-b542-1b8b44cde2e2 => generated 1319 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:41:51.189217 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-aa592474-479a-4f0c-b2c9-8b543eb779ef tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] [instance: 68b71cd8-d4e6-4646-acf7-317020683d8c] Going to try to terminate instance {{(pid=124204) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 10:41:51.272464 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-e67128d0-2b69-4659-9dcb-0a128a942fc7 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:51.273245 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-e67128d0-2b69-4659-9dcb-0a128a942fc7 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] [instance: 5c8d5bc5-4671-4189-94e0-1442e872fc2d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:51.278709 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-aa592474-479a-4f0c-b2c9-8b543eb779ef tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] 10.222.0.59 "DELETE /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c" status: 204 len: 0 microversion: 2.1 time: 0.127813 Jun 30 10:41:51.279294 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 177/362] 10.222.0.59 () {58 vars in 1238 bytes} [Thu Jun 30 10:41:51 2022] DELETE /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 10:41:51.280689 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e67128d0-2b69-4659-9dcb-0a128a942fc7 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:51.281411 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e67128d0-2b69-4659-9dcb-0a128a942fc7 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:51.282222 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e67128d0-2b69-4659-9dcb-0a128a942fc7 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:51.282661 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e67128d0-2b69-4659-9dcb-0a128a942fc7 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:51.288455 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-5a0fcdca-1d26-47fe-a8fc-ebfd7284025d tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:51.289193 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-5a0fcdca-1d26-47fe-a8fc-ebfd7284025d tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] [instance: 68b71cd8-d4e6-4646-acf7-317020683d8c] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:51.295765 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5a0fcdca-1d26-47fe-a8fc-ebfd7284025d tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:51.296217 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5a0fcdca-1d26-47fe-a8fc-ebfd7284025d tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:51.297008 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5a0fcdca-1d26-47fe-a8fc-ebfd7284025d tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:51.297439 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5a0fcdca-1d26-47fe-a8fc-ebfd7284025d tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:51.484733 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-e67128d0-2b69-4659-9dcb-0a128a942fc7 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad75a8b887a4a40accb49603f03c8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d27fbbe7475782fe2202e34aec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:51.488964 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-5a0fcdca-1d26-47fe-a8fc-ebfd7284025d tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c0ccbf16fe4a399945aa5ad34754b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ed6f6064a4cd88a03cf97ab7abeae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:51.492766 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-e67128d0-2b69-4659-9dcb-0a128a942fc7 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] 10.222.0.59 "GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d" status: 200 len: 1553 microversion: 2.1 time: 0.224188 Jun 30 10:41:51.493338 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 186/363] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:51 2022] GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d => generated 1553 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:51.496975 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-5a0fcdca-1d26-47fe-a8fc-ebfd7284025d tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] 10.222.0.59 "GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c" status: 200 len: 1502 microversion: 2.1 time: 0.212679 Jun 30 10:41:51.497595 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 178/364] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:51 2022] GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c => generated 1502 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:41:52.166591 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-7cfd449c-19c0-46f7-be25-26c475af97d4 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:52.167192 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-7cfd449c-19c0-46f7-be25-26c475af97d4 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:52.173301 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-7cfd449c-19c0-46f7-be25-26c475af97d4 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:52.173739 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-7cfd449c-19c0-46f7-be25-26c475af97d4 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:52.175136 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-7cfd449c-19c0-46f7-be25-26c475af97d4 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:52.175568 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-7cfd449c-19c0-46f7-be25-26c475af97d4 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:52.187685 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-13b675e1-dec4-4131-8106-59187176f68d tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:52.188295 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-13b675e1-dec4-4131-8106-59187176f68d tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] [instance: 6385416e-65e3-4edd-b542-1b8b44cde2e2] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:52.195931 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-13b675e1-dec4-4131-8106-59187176f68d tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:52.196378 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-13b675e1-dec4-4131-8106-59187176f68d tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:52.197188 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-13b675e1-dec4-4131-8106-59187176f68d tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:52.197629 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-13b675e1-dec4-4131-8106-59187176f68d tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:52.359071 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-7cfd449c-19c0-46f7-be25-26c475af97d4 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:52.366638 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-7cfd449c-19c0-46f7-be25-26c475af97d4 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1520 microversion: 2.1 time: 0.203882 Jun 30 10:41:52.367858 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 187/365] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:52 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1520 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:52.387763 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-13b675e1-dec4-4131-8106-59187176f68d tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048f9b7d3ad84b439fedd0b80bc6c353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7df7b583a4440ebcf76e5cce3dffc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:52.395678 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-13b675e1-dec4-4131-8106-59187176f68d tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] 10.222.0.59 "GET /compute/v2.1/servers/6385416e-65e3-4edd-b542-1b8b44cde2e2" status: 200 len: 1319 microversion: 2.1 time: 0.211883 Jun 30 10:41:52.396454 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 179/366] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:52 2022] GET /compute/v2.1/servers/6385416e-65e3-4edd-b542-1b8b44cde2e2 => generated 1319 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:41:52.510684 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-32c4e777-10eb-4249-a20f-9721e288ad1f tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:52.511239 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-32c4e777-10eb-4249-a20f-9721e288ad1f tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] [instance: 5c8d5bc5-4671-4189-94e0-1442e872fc2d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:52.514123 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-79917b68-442d-4c05-a325-889b14667b0e tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:52.514725 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-79917b68-442d-4c05-a325-889b14667b0e tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] [instance: 68b71cd8-d4e6-4646-acf7-317020683d8c] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:52.517245 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-32c4e777-10eb-4249-a20f-9721e288ad1f tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:52.518219 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-32c4e777-10eb-4249-a20f-9721e288ad1f tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:52.518992 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-32c4e777-10eb-4249-a20f-9721e288ad1f tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:52.519422 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-32c4e777-10eb-4249-a20f-9721e288ad1f tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:52.521510 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-79917b68-442d-4c05-a325-889b14667b0e tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:52.521945 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-79917b68-442d-4c05-a325-889b14667b0e tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:52.522692 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-79917b68-442d-4c05-a325-889b14667b0e tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:52.523117 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-79917b68-442d-4c05-a325-889b14667b0e tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:52.713121 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-32c4e777-10eb-4249-a20f-9721e288ad1f tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad75a8b887a4a40accb49603f03c8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d27fbbe7475782fe2202e34aec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:52.721188 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-79917b68-442d-4c05-a325-889b14667b0e tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c0ccbf16fe4a399945aa5ad34754b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ed6f6064a4cd88a03cf97ab7abeae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:52.723579 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-32c4e777-10eb-4249-a20f-9721e288ad1f tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] 10.222.0.59 "GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d" status: 200 len: 1553 microversion: 2.1 time: 0.216827 Jun 30 10:41:52.724331 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 188/367] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:52 2022] GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d => generated 1553 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:52.728710 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-79917b68-442d-4c05-a325-889b14667b0e tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] 10.222.0.59 "GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c" status: 200 len: 1502 microversion: 2.1 time: 0.218325 Jun 30 10:41:52.729273 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 180/368] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:52 2022] GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c => generated 1502 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:41:53.384407 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-670172d0-81fe-4652-a070-ed1b4188fccd tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:53.385058 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-670172d0-81fe-4652-a070-ed1b4188fccd tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:53.391246 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-670172d0-81fe-4652-a070-ed1b4188fccd tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:53.391700 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-670172d0-81fe-4652-a070-ed1b4188fccd tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:53.392464 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-670172d0-81fe-4652-a070-ed1b4188fccd tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:53.392921 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-670172d0-81fe-4652-a070-ed1b4188fccd tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:53.412705 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-4bcaf2c8-97d0-49cb-80ec-3a3242b2e1c0 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:53.413234 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-4bcaf2c8-97d0-49cb-80ec-3a3242b2e1c0 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] [instance: 6385416e-65e3-4edd-b542-1b8b44cde2e2] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:53.419845 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-4bcaf2c8-97d0-49cb-80ec-3a3242b2e1c0 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:53.421052 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-4bcaf2c8-97d0-49cb-80ec-3a3242b2e1c0 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:53.421861 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-4bcaf2c8-97d0-49cb-80ec-3a3242b2e1c0 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:53.422297 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-4bcaf2c8-97d0-49cb-80ec-3a3242b2e1c0 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:53.429508 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:41:53.587251 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-670172d0-81fe-4652-a070-ed1b4188fccd tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:53.594866 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-670172d0-81fe-4652-a070-ed1b4188fccd tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1520 microversion: 2.1 time: 0.214446 Jun 30 10:41:53.595696 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 189/369] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:53 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1520 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:53.621481 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-4bcaf2c8-97d0-49cb-80ec-3a3242b2e1c0 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048f9b7d3ad84b439fedd0b80bc6c353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7df7b583a4440ebcf76e5cce3dffc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:53.629902 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-4bcaf2c8-97d0-49cb-80ec-3a3242b2e1c0 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] 10.222.0.59 "GET /compute/v2.1/servers/6385416e-65e3-4edd-b542-1b8b44cde2e2" status: 200 len: 1319 microversion: 2.1 time: 0.221842 Jun 30 10:41:53.630704 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 181/370] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:53 2022] GET /compute/v2.1/servers/6385416e-65e3-4edd-b542-1b8b44cde2e2 => generated 1319 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:41:53.745637 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-d4ac6e61-7623-4177-b4b9-69312171f74e tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:53.746255 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-d4ac6e61-7623-4177-b4b9-69312171f74e tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] [instance: 5c8d5bc5-4671-4189-94e0-1442e872fc2d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:53.756658 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-d4ac6e61-7623-4177-b4b9-69312171f74e tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:53.757104 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-d4ac6e61-7623-4177-b4b9-69312171f74e tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:53.757895 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-d4ac6e61-7623-4177-b4b9-69312171f74e tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:53.758320 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-d4ac6e61-7623-4177-b4b9-69312171f74e tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:53.767444 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-d3cd2365-506d-4a92-b07a-184d64aa85db tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:53.768103 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-d3cd2365-506d-4a92-b07a-184d64aa85db tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] [instance: 68b71cd8-d4e6-4646-acf7-317020683d8c] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:53.777334 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d3cd2365-506d-4a92-b07a-184d64aa85db tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:53.777811 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d3cd2365-506d-4a92-b07a-184d64aa85db tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:53.778628 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d3cd2365-506d-4a92-b07a-184d64aa85db tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:53.779057 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d3cd2365-506d-4a92-b07a-184d64aa85db tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:54.006001 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-d4ac6e61-7623-4177-b4b9-69312171f74e tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad75a8b887a4a40accb49603f03c8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d27fbbe7475782fe2202e34aec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:54.014502 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-d4ac6e61-7623-4177-b4b9-69312171f74e tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] 10.222.0.59 "GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d" status: 200 len: 1553 microversion: 2.1 time: 0.276700 Jun 30 10:41:54.024024 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-d3cd2365-506d-4a92-b07a-184d64aa85db tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c0ccbf16fe4a399945aa5ad34754b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ed6f6064a4cd88a03cf97ab7abeae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:54.024474 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-d3cd2365-506d-4a92-b07a-184d64aa85db tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] 10.222.0.59 "GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c" status: 200 len: 1502 microversion: 2.1 time: 0.260883 Jun 30 10:41:54.024998 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 190/371] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:53 2022] GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d => generated 1553 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:54.025105 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 182/372] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:53 2022] GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c => generated 1502 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:54.035170 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [req-4539ba9a-8cfd-4232-922f-1a94acf36168 req-8de6571d-4eec-4e7f-8e80-3fa616c85080 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6385416e-65e3-4edd-b542-1b8b44cde2e2", "name": "network-vif-plugged", "status": "completed", "tag": "53ed2a07-49c6-458f-a5ea-d7c5dfc5129c"}]} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:41:54.044168 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-4539ba9a-8cfd-4232-922f-1a94acf36168 req-8de6571d-4eec-4e7f-8e80-3fa616c85080 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:54.044871 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-4539ba9a-8cfd-4232-922f-1a94acf36168 req-8de6571d-4eec-4e7f-8e80-3fa616c85080 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:54.061795 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.compute.server_external_events [req-4539ba9a-8cfd-4232-922f-1a94acf36168 req-8de6571d-4eec-4e7f-8e80-3fa616c85080 service nova] Creating event network-vif-plugged:53ed2a07-49c6-458f-a5ea-d7c5dfc5129c for instance 6385416e-65e3-4edd-b542-1b8b44cde2e2 on hv-cinder-82282 Jun 30 10:41:54.067418 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [req-4539ba9a-8cfd-4232-922f-1a94acf36168 req-8de6571d-4eec-4e7f-8e80-3fa616c85080 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037686 Jun 30 10:41:54.068357 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 183/373] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:41:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:41:54.222950 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [req-3b8abcda-dffc-46ba-9451-b766510093f0 req-39344331-f640-4428-897c-f0fd28bc50bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c8d5bc5-4671-4189-94e0-1442e872fc2d", "name": "network-vif-deleted", "tag": "6f18de23-489e-4e05-88b1-28c018e4e789"}]} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:41:54.233514 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-3b8abcda-dffc-46ba-9451-b766510093f0 req-39344331-f640-4428-897c-f0fd28bc50bf service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:54.233952 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-3b8abcda-dffc-46ba-9451-b766510093f0 req-39344331-f640-4428-897c-f0fd28bc50bf service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:54.250168 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.compute.server_external_events [req-3b8abcda-dffc-46ba-9451-b766510093f0 req-39344331-f640-4428-897c-f0fd28bc50bf service nova] Creating event network-vif-deleted:6f18de23-489e-4e05-88b1-28c018e4e789 for instance 5c8d5bc5-4671-4189-94e0-1442e872fc2d on hv-cinder-82282 Jun 30 10:41:54.268032 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [req-3b8abcda-dffc-46ba-9451-b766510093f0 req-39344331-f640-4428-897c-f0fd28bc50bf service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049087 Jun 30 10:41:54.269184 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 191/374] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:41:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:41:54.613343 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-8900cb67-13c4-408d-ad4a-894160460c60 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:54.614125 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-8900cb67-13c4-408d-ad4a-894160460c60 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:54.620570 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-8900cb67-13c4-408d-ad4a-894160460c60 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:54.621023 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-8900cb67-13c4-408d-ad4a-894160460c60 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:54.621776 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-8900cb67-13c4-408d-ad4a-894160460c60 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:54.622209 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-8900cb67-13c4-408d-ad4a-894160460c60 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:54.647772 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-114d479c-78a1-4ce0-89f0-0afe3b0edc91 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:54.648485 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-114d479c-78a1-4ce0-89f0-0afe3b0edc91 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] [instance: 6385416e-65e3-4edd-b542-1b8b44cde2e2] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:54.654820 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-114d479c-78a1-4ce0-89f0-0afe3b0edc91 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:54.655262 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-114d479c-78a1-4ce0-89f0-0afe3b0edc91 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:54.656017 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-114d479c-78a1-4ce0-89f0-0afe3b0edc91 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:54.656445 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-114d479c-78a1-4ce0-89f0-0afe3b0edc91 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:54.827381 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-8900cb67-13c4-408d-ad4a-894160460c60 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:54.845203 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-8900cb67-13c4-408d-ad4a-894160460c60 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1520 microversion: 2.1 time: 0.236465 Jun 30 10:41:54.846135 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 184/375] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:54 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1520 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:54.863219 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-114d479c-78a1-4ce0-89f0-0afe3b0edc91 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048f9b7d3ad84b439fedd0b80bc6c353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7df7b583a4440ebcf76e5cce3dffc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:54.871556 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-114d479c-78a1-4ce0-89f0-0afe3b0edc91 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] 10.222.0.59 "GET /compute/v2.1/servers/6385416e-65e3-4edd-b542-1b8b44cde2e2" status: 200 len: 1319 microversion: 2.1 time: 0.228529 Jun 30 10:41:54.872128 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 192/376] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:54 2022] GET /compute/v2.1/servers/6385416e-65e3-4edd-b542-1b8b44cde2e2 => generated 1319 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:55.031669 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-cbfa6d8f-9dd0-4912-a5a5-b3d6cbb88e8a tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:55.032222 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-cbfa6d8f-9dd0-4912-a5a5-b3d6cbb88e8a tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] [instance: 5c8d5bc5-4671-4189-94e0-1442e872fc2d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:55.038751 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-cbfa6d8f-9dd0-4912-a5a5-b3d6cbb88e8a tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:55.039196 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-cbfa6d8f-9dd0-4912-a5a5-b3d6cbb88e8a tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:55.039959 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-cbfa6d8f-9dd0-4912-a5a5-b3d6cbb88e8a tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:55.040391 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-cbfa6d8f-9dd0-4912-a5a5-b3d6cbb88e8a tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:55.042967 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-4afd19cb-7ce5-40aa-ad0e-18f29d5fb1f6 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:55.043738 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-4afd19cb-7ce5-40aa-ad0e-18f29d5fb1f6 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] [instance: 68b71cd8-d4e6-4646-acf7-317020683d8c] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:55.050532 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-4afd19cb-7ce5-40aa-ad0e-18f29d5fb1f6 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:55.050975 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-4afd19cb-7ce5-40aa-ad0e-18f29d5fb1f6 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:55.051758 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-4afd19cb-7ce5-40aa-ad0e-18f29d5fb1f6 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:55.052203 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-4afd19cb-7ce5-40aa-ad0e-18f29d5fb1f6 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:55.071474 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-cbfa6d8f-9dd0-4912-a5a5-b3d6cbb88e8a tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:55.071928 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-cbfa6d8f-9dd0-4912-a5a5-b3d6cbb88e8a tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:55.072391 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.objects.instance [None req-cbfa6d8f-9dd0-4912-a5a5-b3d6cbb88e8a tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lazy-loading 'fault' on Instance uuid 5c8d5bc5-4671-4189-94e0-1442e872fc2d {{(pid=124204) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 10:41:55.084540 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-4afd19cb-7ce5-40aa-ad0e-18f29d5fb1f6 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:55.084983 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-4afd19cb-7ce5-40aa-ad0e-18f29d5fb1f6 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:55.085439 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.objects.instance [None req-4afd19cb-7ce5-40aa-ad0e-18f29d5fb1f6 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lazy-loading 'fault' on Instance uuid 68b71cd8-d4e6-4646-acf7-317020683d8c {{(pid=124203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 10:41:55.130376 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-cbfa6d8f-9dd0-4912-a5a5-b3d6cbb88e8a tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad75a8b887a4a40accb49603f03c8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d27fbbe7475782fe2202e34aec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:55.138402 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-cbfa6d8f-9dd0-4912-a5a5-b3d6cbb88e8a tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] 10.222.0.59 "GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d" status: 200 len: 1350 microversion: 2.1 time: 0.110649 Jun 30 10:41:55.138977 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 185/377] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:55 2022] GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d => generated 1350 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:55.146192 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-4afd19cb-7ce5-40aa-ad0e-18f29d5fb1f6 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c0ccbf16fe4a399945aa5ad34754b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ed6f6064a4cd88a03cf97ab7abeae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:55.153655 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-4afd19cb-7ce5-40aa-ad0e-18f29d5fb1f6 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] 10.222.0.59 "GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c" status: 200 len: 1303 microversion: 2.1 time: 0.116475 Jun 30 10:41:55.154202 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 193/378] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:55 2022] GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c => generated 1303 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:41:55.863699 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-c282791a-cba2-4381-8a2b-be23288bdb6c tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:55.864311 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-c282791a-cba2-4381-8a2b-be23288bdb6c tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:55.870889 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c282791a-cba2-4381-8a2b-be23288bdb6c tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:55.871340 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c282791a-cba2-4381-8a2b-be23288bdb6c tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:55.872130 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c282791a-cba2-4381-8a2b-be23288bdb6c tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:55.872787 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c282791a-cba2-4381-8a2b-be23288bdb6c tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:55.888280 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-386513d1-a612-4bee-8499-b127dc2f3993 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:55.888946 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-386513d1-a612-4bee-8499-b127dc2f3993 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] [instance: 6385416e-65e3-4edd-b542-1b8b44cde2e2] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:55.894982 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-386513d1-a612-4bee-8499-b127dc2f3993 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:55.895428 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-386513d1-a612-4bee-8499-b127dc2f3993 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:55.896182 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-386513d1-a612-4bee-8499-b127dc2f3993 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:55.896641 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-386513d1-a612-4bee-8499-b127dc2f3993 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:56.066193 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-c282791a-cba2-4381-8a2b-be23288bdb6c tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:56.073737 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-c282791a-cba2-4381-8a2b-be23288bdb6c tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1520 microversion: 2.1 time: 0.214486 Jun 30 10:41:56.074305 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 186/379] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:55 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1520 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:56.089835 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-386513d1-a612-4bee-8499-b127dc2f3993 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048f9b7d3ad84b439fedd0b80bc6c353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7df7b583a4440ebcf76e5cce3dffc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:56.097890 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-386513d1-a612-4bee-8499-b127dc2f3993 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] 10.222.0.59 "GET /compute/v2.1/servers/6385416e-65e3-4edd-b542-1b8b44cde2e2" status: 200 len: 1319 microversion: 2.1 time: 0.212822 Jun 30 10:41:56.098449 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 194/380] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:55 2022] GET /compute/v2.1/servers/6385416e-65e3-4edd-b542-1b8b44cde2e2 => generated 1319 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:41:56.156157 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-69663c30-7689-4796-88e8-fbab39522afe tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:56.156759 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-69663c30-7689-4796-88e8-fbab39522afe tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] [instance: 5c8d5bc5-4671-4189-94e0-1442e872fc2d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:56.163621 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-69663c30-7689-4796-88e8-fbab39522afe tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:56.165274 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-69663c30-7689-4796-88e8-fbab39522afe tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:56.165274 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-69663c30-7689-4796-88e8-fbab39522afe tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:56.165274 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-69663c30-7689-4796-88e8-fbab39522afe tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:56.170533 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-38782f59-0139-4db3-850b-9866bc084e4d tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:56.171136 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-38782f59-0139-4db3-850b-9866bc084e4d tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] [instance: 68b71cd8-d4e6-4646-acf7-317020683d8c] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:56.177066 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-38782f59-0139-4db3-850b-9866bc084e4d tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:56.177502 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-38782f59-0139-4db3-850b-9866bc084e4d tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:56.178254 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-38782f59-0139-4db3-850b-9866bc084e4d tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:56.178681 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-38782f59-0139-4db3-850b-9866bc084e4d tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:56.196832 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-69663c30-7689-4796-88e8-fbab39522afe tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:56.197283 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-69663c30-7689-4796-88e8-fbab39522afe tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:56.197726 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.objects.instance [None req-69663c30-7689-4796-88e8-fbab39522afe tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lazy-loading 'fault' on Instance uuid 5c8d5bc5-4671-4189-94e0-1442e872fc2d {{(pid=124204) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 10:41:56.211943 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-38782f59-0139-4db3-850b-9866bc084e4d tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:56.211943 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-38782f59-0139-4db3-850b-9866bc084e4d tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:56.212294 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.objects.instance [None req-38782f59-0139-4db3-850b-9866bc084e4d tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lazy-loading 'fault' on Instance uuid 68b71cd8-d4e6-4646-acf7-317020683d8c {{(pid=124203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 10:41:56.261326 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-69663c30-7689-4796-88e8-fbab39522afe tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad75a8b887a4a40accb49603f03c8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d27fbbe7475782fe2202e34aec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:56.270167 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-69663c30-7689-4796-88e8-fbab39522afe tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] 10.222.0.59 "GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d" status: 200 len: 1350 microversion: 2.1 time: 0.117910 Jun 30 10:41:56.270740 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 187/381] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:56 2022] GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d => generated 1350 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:56.284053 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-38782f59-0139-4db3-850b-9866bc084e4d tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c0ccbf16fe4a399945aa5ad34754b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ed6f6064a4cd88a03cf97ab7abeae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:56.292358 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-38782f59-0139-4db3-850b-9866bc084e4d tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] 10.222.0.59 "GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c" status: 200 len: 1303 microversion: 2.1 time: 0.125561 Jun 30 10:41:56.298571 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 195/382] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:56 2022] GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c => generated 1303 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:56.310168 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [req-d2c43dda-fd70-4961-8743-5f2c54082952 req-f97156f7-49ab-4f1e-a68c-5aaec9fa6949 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68b71cd8-d4e6-4646-acf7-317020683d8c", "name": "network-vif-deleted", "tag": "ad7f39dc-4189-449d-90a6-f5875e739022"}]} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:41:56.318576 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-d2c43dda-fd70-4961-8743-5f2c54082952 req-f97156f7-49ab-4f1e-a68c-5aaec9fa6949 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:56.319333 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-d2c43dda-fd70-4961-8743-5f2c54082952 req-f97156f7-49ab-4f1e-a68c-5aaec9fa6949 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:56.330793 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.compute.server_external_events [req-d2c43dda-fd70-4961-8743-5f2c54082952 req-f97156f7-49ab-4f1e-a68c-5aaec9fa6949 service nova] Creating event network-vif-deleted:ad7f39dc-4189-449d-90a6-f5875e739022 for instance 68b71cd8-d4e6-4646-acf7-317020683d8c on hv-cinder-82282 Jun 30 10:41:56.337441 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [req-d2c43dda-fd70-4961-8743-5f2c54082952 req-f97156f7-49ab-4f1e-a68c-5aaec9fa6949 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031263 Jun 30 10:41:56.338540 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 188/383] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:41:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 10:41:57.092375 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-9623b836-d3dd-4a40-9010-cbec86dd3805 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:57.093022 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-9623b836-d3dd-4a40-9010-cbec86dd3805 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:57.099144 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-9623b836-d3dd-4a40-9010-cbec86dd3805 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:57.099591 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-9623b836-d3dd-4a40-9010-cbec86dd3805 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:57.100379 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-9623b836-d3dd-4a40-9010-cbec86dd3805 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:57.100918 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-9623b836-d3dd-4a40-9010-cbec86dd3805 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:57.115976 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-8f93104b-82f4-4693-aeb3-37f9acf4d09c tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:57.117322 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-8f93104b-82f4-4693-aeb3-37f9acf4d09c tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] [instance: 6385416e-65e3-4edd-b542-1b8b44cde2e2] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:57.123515 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-8f93104b-82f4-4693-aeb3-37f9acf4d09c tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:57.124165 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-8f93104b-82f4-4693-aeb3-37f9acf4d09c tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:57.125158 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-8f93104b-82f4-4693-aeb3-37f9acf4d09c tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:57.125880 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-8f93104b-82f4-4693-aeb3-37f9acf4d09c tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:57.297194 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-9623b836-d3dd-4a40-9010-cbec86dd3805 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:57.305276 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-9623b836-d3dd-4a40-9010-cbec86dd3805 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1520 microversion: 2.1 time: 0.217933 Jun 30 10:41:57.305854 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 196/384] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:57 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1520 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:57.310464 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-2b6faa14-d9f5-44ab-ab2f-e487df779262 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:57.311111 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-2b6faa14-d9f5-44ab-ab2f-e487df779262 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] [instance: 5c8d5bc5-4671-4189-94e0-1442e872fc2d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:57.317270 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-2b6faa14-d9f5-44ab-ab2f-e487df779262 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:57.317937 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-2b6faa14-d9f5-44ab-ab2f-e487df779262 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:57.318879 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-2b6faa14-d9f5-44ab-ab2f-e487df779262 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:57.319313 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-2b6faa14-d9f5-44ab-ab2f-e487df779262 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:57.324452 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-8f93104b-82f4-4693-aeb3-37f9acf4d09c tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048f9b7d3ad84b439fedd0b80bc6c353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7df7b583a4440ebcf76e5cce3dffc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:57.332466 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-8f93104b-82f4-4693-aeb3-37f9acf4d09c tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] 10.222.0.59 "GET /compute/v2.1/servers/6385416e-65e3-4edd-b542-1b8b44cde2e2" status: 200 len: 1507 microversion: 2.1 time: 0.221688 Jun 30 10:41:57.333063 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 189/385] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:57 2022] GET /compute/v2.1/servers/6385416e-65e3-4edd-b542-1b8b44cde2e2 => generated 1507 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:41:57.333185 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.wsgi [None req-2b6faa14-d9f5-44ab-ab2f-e487df779262 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] HTTP exception thrown: Instance 5c8d5bc5-4671-4189-94e0-1442e872fc2d could not be found. Jun 30 10:41:57.337404 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-e9656092-3f67-49ae-a74c-5d31fd933554 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:57.338005 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-e9656092-3f67-49ae-a74c-5d31fd933554 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] [instance: 68b71cd8-d4e6-4646-acf7-317020683d8c] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:57.343709 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-e9656092-3f67-49ae-a74c-5d31fd933554 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:57.344446 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-e9656092-3f67-49ae-a74c-5d31fd933554 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:57.345143 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-2b6faa14-d9f5-44ab-ab2f-e487df779262 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Request method failure captured: Jun 30 10:41:57.345143 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: request: GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d HTTP/1.1 Jun 30 10:41:57.345143 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Accept: application/json Jun 30 10:41:57.345143 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Accept-Encoding: identity Jun 30 10:41:57.345143 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Connection: close Jun 30 10:41:57.345143 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Content-Length: 0 Jun 30 10:41:57.345143 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Content-Type: application/json Jun 30 10:41:57.345143 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Host: 10.222.0.59 Jun 30 10:41:57.345143 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Openstack-System-Scope: None Jun 30 10:41:57.345143 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: User-Agent: python-urllib3/1.26.9 Jun 30 10:41:57.345143 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Auth-Token: gAAAAABivX2Nx29dJQn5YAjIG_Xxg_F55cYzgSPDTaqWBpq6ZPwFIf_O8bXwSJZmoGpO_v0mf0ipZyDN1Qfsgdoki9djC8q21ZH9Q2kjJtJaWJokjpuRaExgQODKaAMyfa7IKJ5y2WSh4zIrpMdjecnAw2oI_4rIMu7nlb-iUgl5rfpgeioPPCY Jun 30 10:41:57.345143 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Domain-Id: None Jun 30 10:41:57.345143 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Domain-Name: None Jun 30 10:41:57.345143 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Identity-Status: Confirmed Jun 30 10:41:57.345143 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Is-Admin-Project: True Jun 30 10:41:57.345143 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Domain-Id: default Jun 30 10:41:57.345143 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Domain-Name: Default Jun 30 10:41:57.345143 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Id: ff16d27fbbe7475782fe2202e34aec7f Jun 30 10:41:57.345143 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Name: tempest-DeleteServersTestJSON-459273914 Jun 30 10:41:57.345143 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Role: member,reader Jun 30 10:41:57.345143 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Roles: member,reader Jun 30 10:41:57.346392 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ff16d27fbbe7475782fe2202e34aec7f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ff16d27fbbe7475782fe2202e34aec7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ff16d27fbbe7475782fe2202e34aec7f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ff16d27fbbe7475782fe2202e34aec7f"}]}] Jun 30 10:41:57.346392 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant: tempest-DeleteServersTestJSON-459273914 Jun 30 10:41:57.346392 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant-Id: ff16d27fbbe7475782fe2202e34aec7f Jun 30 10:41:57.346392 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant-Name: tempest-DeleteServersTestJSON-459273914 Jun 30 10:41:57.346392 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User: tempest-DeleteServersTestJSON-459273914-project Jun 30 10:41:57.346392 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Domain-Id: default Jun 30 10:41:57.346392 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Domain-Name: Default Jun 30 10:41:57.346392 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Id: 9ad75a8b887a4a40accb49603f03c8ee Jun 30 10:41:57.346392 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Name: tempest-DeleteServersTestJSON-459273914-project Jun 30 10:41:57.346392 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: method: > Jun 30 10:41:57.346392 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: exception: Instance 5c8d5bc5-4671-4189-94e0-1442e872fc2d could not be found. Jun 30 10:41:57.346392 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: action_args: {'id': '5c8d5bc5-4671-4189-94e0-1442e872fc2d'} Jun 30 10:41:57.348229 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:41:57.348229 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:41:57.348229 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 10:41:57.348229 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 10:41:57.348229 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 10:41:57.348229 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 10:41:57.348229 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 10:41:57.348229 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 10:41:57.348229 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 10:41:57.348229 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 10:41:57.348229 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c8d5bc5-4671-4189-94e0-1442e872fc2d could not be found. Jun 30 10:41:57.348229 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:41:57.348229 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:41:57.348229 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:41:57.348229 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:41:57.348229 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:41:57.348229 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:41:57.348229 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:41:57.348229 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:41:57.348229 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:41:57.350140 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:41:57.350140 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 10:41:57.350140 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 10:41:57.350140 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 10:41:57.350140 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 10:41:57.350140 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 10:41:57.350140 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:41:57.350140 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c8d5bc5-4671-4189-94e0-1442e872fc2d could not be found. Jun 30 10:41:57.350140 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:41:57.350140 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:41:57.350140 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:41:57.350140 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:41:57.350140 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:41:57.350140 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:41:57.350140 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:41:57.350140 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:41:57.350140 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c8d5bc5-4671-4189-94e0-1442e872fc2d could not be found. Jun 30 10:41:57.350140 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:41:57.351646 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-e9656092-3f67-49ae-a74c-5d31fd933554 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:57.351728 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-2b6faa14-d9f5-44ab-ab2f-e487df779262 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Returning 404 to user: Instance 5c8d5bc5-4671-4189-94e0-1442e872fc2d could not be found. {{(pid=124203) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:41:57.351800 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-e9656092-3f67-49ae-a74c-5d31fd933554 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:57.352112 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-2b6faa14-d9f5-44ab-ab2f-e487df779262 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] 10.222.0.59 "GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d" status: 404 len: 111 microversion: 2.1 time: 0.039861 Jun 30 10:41:57.352112 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 197/386] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:57 2022] GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 10:41:57.370723 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.wsgi [None req-e9656092-3f67-49ae-a74c-5d31fd933554 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] HTTP exception thrown: Instance 68b71cd8-d4e6-4646-acf7-317020683d8c could not be found. Jun 30 10:41:57.376295 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-e9656092-3f67-49ae-a74c-5d31fd933554 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Request method failure captured: Jun 30 10:41:57.376295 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: request: GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c HTTP/1.1 Jun 30 10:41:57.376295 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Accept: application/json Jun 30 10:41:57.376295 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Accept-Encoding: identity Jun 30 10:41:57.376295 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Connection: close Jun 30 10:41:57.376295 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Content-Length: 0 Jun 30 10:41:57.376295 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Content-Type: application/json Jun 30 10:41:57.376295 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Host: 10.222.0.59 Jun 30 10:41:57.376295 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Openstack-System-Scope: None Jun 30 10:41:57.376295 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: User-Agent: python-urllib3/1.26.9 Jun 30 10:41:57.376295 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Auth-Token: gAAAAABivX3Aim7t3mGoy3qB9lhBWfpZ0AfKZ_rPrilUCfs_KAIfXHqF9VTg0oSec75SYQzwOzL3G0mKWiFdYHWbA9kOp6iDAAYV5WQCJfhorbl2Nc7ooUDmt9DBc8PUWyH7xS-tGwKLz4AP--nZi5iVQXSALt6SQ0lfyS7gJ-cXDqHnU-DDv-Y Jun 30 10:41:57.376295 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Domain-Id: None Jun 30 10:41:57.376295 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Domain-Name: None Jun 30 10:41:57.376295 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Identity-Status: Confirmed Jun 30 10:41:57.376295 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Is-Admin-Project: True Jun 30 10:41:57.376295 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Domain-Id: default Jun 30 10:41:57.376295 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Domain-Name: Default Jun 30 10:41:57.376295 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Id: d60ed6f6064a4cd88a03cf97ab7abeae Jun 30 10:41:57.376295 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Name: tempest-VolumesActionsTest-848241142 Jun 30 10:41:57.376295 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Role: member,reader Jun 30 10:41:57.376295 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Roles: member,reader Jun 30 10:41:57.377749 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d60ed6f6064a4cd88a03cf97ab7abeae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d60ed6f6064a4cd88a03cf97ab7abeae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d60ed6f6064a4cd88a03cf97ab7abeae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d60ed6f6064a4cd88a03cf97ab7abeae"}]}] Jun 30 10:41:57.377749 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant: tempest-VolumesActionsTest-848241142 Jun 30 10:41:57.377749 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant-Id: d60ed6f6064a4cd88a03cf97ab7abeae Jun 30 10:41:57.377749 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant-Name: tempest-VolumesActionsTest-848241142 Jun 30 10:41:57.377749 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User: tempest-VolumesActionsTest-848241142-project Jun 30 10:41:57.377749 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Domain-Id: default Jun 30 10:41:57.377749 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Domain-Name: Default Jun 30 10:41:57.377749 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Id: f5c0ccbf16fe4a399945aa5ad34754b5 Jun 30 10:41:57.377749 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Name: tempest-VolumesActionsTest-848241142-project Jun 30 10:41:57.377749 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: method: > Jun 30 10:41:57.377749 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: exception: Instance 68b71cd8-d4e6-4646-acf7-317020683d8c could not be found. Jun 30 10:41:57.377749 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: action_args: {'id': '68b71cd8-d4e6-4646-acf7-317020683d8c'} Jun 30 10:41:57.378643 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:41:57.378643 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:41:57.378643 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 10:41:57.378643 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 10:41:57.378643 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 10:41:57.378643 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 10:41:57.378643 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 10:41:57.378643 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 10:41:57.378643 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 10:41:57.378643 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 10:41:57.378643 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68b71cd8-d4e6-4646-acf7-317020683d8c could not be found. Jun 30 10:41:57.378643 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:41:57.378643 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:41:57.378643 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:41:57.378643 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:41:57.378643 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:41:57.378643 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:41:57.378643 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:41:57.378643 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:41:57.378643 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:41:57.379987 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:41:57.379987 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 10:41:57.379987 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 10:41:57.379987 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 10:41:57.379987 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 10:41:57.379987 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 10:41:57.379987 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:41:57.379987 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68b71cd8-d4e6-4646-acf7-317020683d8c could not be found. Jun 30 10:41:57.379987 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:41:57.379987 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:41:57.379987 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:41:57.379987 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:41:57.379987 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:41:57.379987 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:41:57.379987 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:41:57.379987 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:41:57.379987 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68b71cd8-d4e6-4646-acf7-317020683d8c could not be found. Jun 30 10:41:57.379987 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:41:57.381203 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-e9656092-3f67-49ae-a74c-5d31fd933554 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Returning 404 to user: Instance 68b71cd8-d4e6-4646-acf7-317020683d8c could not be found. {{(pid=124204) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:41:57.381203 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-e9656092-3f67-49ae-a74c-5d31fd933554 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] 10.222.0.59 "GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c" status: 404 len: 111 microversion: 2.1 time: 0.044394 Jun 30 10:41:57.381203 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 190/387] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:57 2022] GET /compute/v2.1/servers/68b71cd8-d4e6-4646-acf7-317020683d8c => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 10:41:57.485985 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-f2f1fd2e-9175-4b75-852c-e141eaac7abf tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1824448167", "imageRef": "c473bd04-5a45-4eb7-b6f4-2b5033d4fc1d", "flavorRef": "452", "networks": [{"uuid": "6a2aa940-442e-40ee-bf15-ffb569bc03f6"}]}} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:41:57.489489 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-a205a948-ed3c-489c-bc84-c9c789ce2f5e tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:57.490586 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-a205a948-ed3c-489c-bc84-c9c789ce2f5e tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] [instance: 5c8d5bc5-4671-4189-94e0-1442e872fc2d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:57.501294 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a205a948-ed3c-489c-bc84-c9c789ce2f5e tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:57.501989 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a205a948-ed3c-489c-bc84-c9c789ce2f5e tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:57.503129 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a205a948-ed3c-489c-bc84-c9c789ce2f5e tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:57.503742 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a205a948-ed3c-489c-bc84-c9c789ce2f5e tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:57.518448 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.wsgi [None req-a205a948-ed3c-489c-bc84-c9c789ce2f5e tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] HTTP exception thrown: Instance 5c8d5bc5-4671-4189-94e0-1442e872fc2d could not be found. Jun 30 10:41:57.529130 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-a205a948-ed3c-489c-bc84-c9c789ce2f5e tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Request method failure captured: Jun 30 10:41:57.529130 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: request: GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d/os-volume_attachments HTTP/1.1 Jun 30 10:41:57.529130 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Accept: application/json Jun 30 10:41:57.529130 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Accept-Encoding: identity Jun 30 10:41:57.529130 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Connection: close Jun 30 10:41:57.529130 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Content-Length: 0 Jun 30 10:41:57.529130 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Content-Type: application/json Jun 30 10:41:57.529130 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Host: 10.222.0.59 Jun 30 10:41:57.529130 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Openstack-System-Scope: None Jun 30 10:41:57.529130 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: User-Agent: python-urllib3/1.26.9 Jun 30 10:41:57.529130 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Auth-Token: gAAAAABivX2Nx29dJQn5YAjIG_Xxg_F55cYzgSPDTaqWBpq6ZPwFIf_O8bXwSJZmoGpO_v0mf0ipZyDN1Qfsgdoki9djC8q21ZH9Q2kjJtJaWJokjpuRaExgQODKaAMyfa7IKJ5y2WSh4zIrpMdjecnAw2oI_4rIMu7nlb-iUgl5rfpgeioPPCY Jun 30 10:41:57.529130 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Domain-Id: None Jun 30 10:41:57.529130 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Domain-Name: None Jun 30 10:41:57.529130 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Identity-Status: Confirmed Jun 30 10:41:57.529130 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Is-Admin-Project: True Jun 30 10:41:57.529130 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Domain-Id: default Jun 30 10:41:57.529130 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Domain-Name: Default Jun 30 10:41:57.529130 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Id: ff16d27fbbe7475782fe2202e34aec7f Jun 30 10:41:57.529130 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Name: tempest-DeleteServersTestJSON-459273914 Jun 30 10:41:57.529130 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Role: member,reader Jun 30 10:41:57.529130 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Roles: member,reader Jun 30 10:41:57.530566 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ff16d27fbbe7475782fe2202e34aec7f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ff16d27fbbe7475782fe2202e34aec7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ff16d27fbbe7475782fe2202e34aec7f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ff16d27fbbe7475782fe2202e34aec7f"}]}] Jun 30 10:41:57.530566 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant: tempest-DeleteServersTestJSON-459273914 Jun 30 10:41:57.530566 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant-Id: ff16d27fbbe7475782fe2202e34aec7f Jun 30 10:41:57.530566 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant-Name: tempest-DeleteServersTestJSON-459273914 Jun 30 10:41:57.530566 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User: tempest-DeleteServersTestJSON-459273914-project Jun 30 10:41:57.530566 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Domain-Id: default Jun 30 10:41:57.530566 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Domain-Name: Default Jun 30 10:41:57.530566 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Id: 9ad75a8b887a4a40accb49603f03c8ee Jun 30 10:41:57.530566 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Name: tempest-DeleteServersTestJSON-459273914-project Jun 30 10:41:57.530566 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: method: > Jun 30 10:41:57.530566 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: exception: Instance 5c8d5bc5-4671-4189-94e0-1442e872fc2d could not be found. Jun 30 10:41:57.530566 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: action_args: {'server_id': '5c8d5bc5-4671-4189-94e0-1442e872fc2d'} Jun 30 10:41:57.531331 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:41:57.531331 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:41:57.531331 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 10:41:57.531331 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 10:41:57.531331 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 10:41:57.531331 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 10:41:57.531331 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 10:41:57.531331 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 10:41:57.531331 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 10:41:57.531331 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 10:41:57.531331 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c8d5bc5-4671-4189-94e0-1442e872fc2d could not be found. Jun 30 10:41:57.531331 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:41:57.531331 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:41:57.531331 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:41:57.531331 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:41:57.531331 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:41:57.531331 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:41:57.531331 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:41:57.531331 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:41:57.531331 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:41:57.532525 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:41:57.532525 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 30 10:41:57.532525 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 10:41:57.532525 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 30 10:41:57.532525 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 10:41:57.532525 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 30 10:41:57.532525 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 30 10:41:57.532525 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 10:41:57.532525 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:41:57.532525 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c8d5bc5-4671-4189-94e0-1442e872fc2d could not be found. Jun 30 10:41:57.532525 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:41:57.532525 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:41:57.532525 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:41:57.532525 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:41:57.532525 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:41:57.532525 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:41:57.532525 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:41:57.532525 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:41:57.532525 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c8d5bc5-4671-4189-94e0-1442e872fc2d could not be found. Jun 30 10:41:57.532525 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:41:57.533912 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-a205a948-ed3c-489c-bc84-c9c789ce2f5e tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Returning 404 to user: Instance 5c8d5bc5-4671-4189-94e0-1442e872fc2d could not be found. {{(pid=124203) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:41:57.533912 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-a205a948-ed3c-489c-bc84-c9c789ce2f5e tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] 10.222.0.59 "GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.046113 Jun 30 10:41:57.533912 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 198/388] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 30 10:41:57 2022] GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d/os-volume_attachments => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 10:41:57.563140 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.network.neutron [None req-f2f1fd2e-9175-4b75-852c-e141eaac7abf tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] validate_networks() for [('6a2aa940-442e-40ee-bf15-ffb569bc03f6', None, None, None, None, None)] {{(pid=124204) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 10:41:57.966919 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.virt.hardware [None req-f2f1fd2e-9175-4b75-852c-e141eaac7abf tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Flavor limits 0:0:0 {{(pid=124204) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 10:41:57.967337 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.virt.hardware [None req-f2f1fd2e-9175-4b75-852c-e141eaac7abf tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Image limits 0:0:0 {{(pid=124204) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 10:41:57.967812 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.virt.hardware [None req-f2f1fd2e-9175-4b75-852c-e141eaac7abf tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Flavor pref 0:0:0 {{(pid=124204) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 10:41:57.968222 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.virt.hardware [None req-f2f1fd2e-9175-4b75-852c-e141eaac7abf tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Image pref 0:0:0 {{(pid=124204) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 10:41:57.968669 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.virt.hardware [None req-f2f1fd2e-9175-4b75-852c-e141eaac7abf tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124204) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 10:41:57.977762 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f2f1fd2e-9175-4b75-852c-e141eaac7abf tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:57.978203 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f2f1fd2e-9175-4b75-852c-e141eaac7abf tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:57.979001 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f2f1fd2e-9175-4b75-852c-e141eaac7abf tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:57.979436 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f2f1fd2e-9175-4b75-852c-e141eaac7abf tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:57.996128 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.quota [None req-f2f1fd2e-9175-4b75-852c-e141eaac7abf tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Getting quotas for project d60ed6f6064a4cd88a03cf97ab7abeae. Resources: {'instances', 'cores', 'ram'} {{(pid=124204) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 10:41:58.000051 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.quota [None req-f2f1fd2e-9175-4b75-852c-e141eaac7abf tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Getting quotas for user f5c0ccbf16fe4a399945aa5ad34754b5 and project d60ed6f6064a4cd88a03cf97ab7abeae. Resources: {'instances', 'cores', 'ram'} {{(pid=124204) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 10:41:58.012267 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-f2f1fd2e-9175-4b75-852c-e141eaac7abf tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Going to run 1 instances... {{(pid=124204) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 10:41:58.014682 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-f2f1fd2e-9175-4b75-852c-e141eaac7abf tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] [instance: 6be3f98f-ff1d-4e22-8109-756f8c516b08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c473bd04-5a45-4eb7-b6f4-2b5033d4fc1d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124204) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 10:41:58.060720 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-f2f1fd2e-9175-4b75-852c-e141eaac7abf tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.578822 Jun 30 10:41:58.061624 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 191/389] 10.222.0.59 () {60 vars in 1146 bytes} [Thu Jun 30 10:41:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 10:41:58.072474 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-d57e229a-cafc-4c06-97d7-671795e43a1f tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:58.073124 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-d57e229a-cafc-4c06-97d7-671795e43a1f tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] [instance: 6be3f98f-ff1d-4e22-8109-756f8c516b08] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:58.133046 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-d57e229a-cafc-4c06-97d7-671795e43a1f tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c0ccbf16fe4a399945aa5ad34754b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ed6f6064a4cd88a03cf97ab7abeae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:58.140141 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-d57e229a-cafc-4c06-97d7-671795e43a1f tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] 10.222.0.59 "GET /compute/v2.1/servers/6be3f98f-ff1d-4e22-8109-756f8c516b08" status: 200 len: 1214 microversion: 2.1 time: 0.071884 Jun 30 10:41:58.140799 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 199/390] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:58 2022] GET /compute/v2.1/servers/6be3f98f-ff1d-4e22-8109-756f8c516b08 => generated 1214 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:58.323112 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-0dbacf02-2dd8-4849-80bf-faaaa815af23 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:58.324467 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-0dbacf02-2dd8-4849-80bf-faaaa815af23 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:58.333452 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-0dbacf02-2dd8-4849-80bf-faaaa815af23 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:58.333924 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-0dbacf02-2dd8-4849-80bf-faaaa815af23 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:58.334675 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-0dbacf02-2dd8-4849-80bf-faaaa815af23 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:58.335111 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-0dbacf02-2dd8-4849-80bf-faaaa815af23 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:58.482077 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-0dbacf02-2dd8-4849-80bf-faaaa815af23 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:58.492441 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-0dbacf02-2dd8-4849-80bf-faaaa815af23 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1520 microversion: 2.1 time: 0.173264 Jun 30 10:41:58.493062 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 192/391] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:58 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:58.762829 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-115803e9-f530-490f-8cd2-0b553c7df21a tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:58.763442 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-115803e9-f530-490f-8cd2-0b553c7df21a tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] [instance: 5c8d5bc5-4671-4189-94e0-1442e872fc2d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:58.769502 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-115803e9-f530-490f-8cd2-0b553c7df21a tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:58.769950 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-115803e9-f530-490f-8cd2-0b553c7df21a tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:58.770715 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-115803e9-f530-490f-8cd2-0b553c7df21a tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:58.771156 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-115803e9-f530-490f-8cd2-0b553c7df21a tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:58.784315 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.wsgi [None req-115803e9-f530-490f-8cd2-0b553c7df21a tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] HTTP exception thrown: Instance 5c8d5bc5-4671-4189-94e0-1442e872fc2d could not be found. Jun 30 10:41:58.786426 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-115803e9-f530-490f-8cd2-0b553c7df21a tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Request method failure captured: Jun 30 10:41:58.786426 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: request: DELETE /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d HTTP/1.1 Jun 30 10:41:58.786426 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Accept: application/json Jun 30 10:41:58.786426 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Accept-Encoding: identity Jun 30 10:41:58.786426 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Connection: close Jun 30 10:41:58.786426 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Content-Length: 0 Jun 30 10:41:58.786426 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Content-Type: application/json Jun 30 10:41:58.786426 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Host: 10.222.0.59 Jun 30 10:41:58.786426 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Openstack-System-Scope: None Jun 30 10:41:58.786426 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: User-Agent: python-urllib3/1.26.9 Jun 30 10:41:58.786426 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Auth-Token: gAAAAABivX2Nx29dJQn5YAjIG_Xxg_F55cYzgSPDTaqWBpq6ZPwFIf_O8bXwSJZmoGpO_v0mf0ipZyDN1Qfsgdoki9djC8q21ZH9Q2kjJtJaWJokjpuRaExgQODKaAMyfa7IKJ5y2WSh4zIrpMdjecnAw2oI_4rIMu7nlb-iUgl5rfpgeioPPCY Jun 30 10:41:58.786426 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Domain-Id: None Jun 30 10:41:58.786426 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Domain-Name: None Jun 30 10:41:58.786426 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Identity-Status: Confirmed Jun 30 10:41:58.786426 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Is-Admin-Project: True Jun 30 10:41:58.786426 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Domain-Id: default Jun 30 10:41:58.786426 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Domain-Name: Default Jun 30 10:41:58.786426 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Id: ff16d27fbbe7475782fe2202e34aec7f Jun 30 10:41:58.786426 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Name: tempest-DeleteServersTestJSON-459273914 Jun 30 10:41:58.786426 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Role: member,reader Jun 30 10:41:58.786426 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Roles: member,reader Jun 30 10:41:58.787601 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ff16d27fbbe7475782fe2202e34aec7f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ff16d27fbbe7475782fe2202e34aec7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ff16d27fbbe7475782fe2202e34aec7f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ff16d27fbbe7475782fe2202e34aec7f"}]}] Jun 30 10:41:58.787601 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant: tempest-DeleteServersTestJSON-459273914 Jun 30 10:41:58.787601 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant-Id: ff16d27fbbe7475782fe2202e34aec7f Jun 30 10:41:58.787601 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant-Name: tempest-DeleteServersTestJSON-459273914 Jun 30 10:41:58.787601 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User: tempest-DeleteServersTestJSON-459273914-project Jun 30 10:41:58.787601 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Domain-Id: default Jun 30 10:41:58.787601 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Domain-Name: Default Jun 30 10:41:58.787601 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Id: 9ad75a8b887a4a40accb49603f03c8ee Jun 30 10:41:58.787601 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Name: tempest-DeleteServersTestJSON-459273914-project Jun 30 10:41:58.787601 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: method: > Jun 30 10:41:58.787601 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: exception: Instance 5c8d5bc5-4671-4189-94e0-1442e872fc2d could not be found. Jun 30 10:41:58.787601 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: action_args: {'id': '5c8d5bc5-4671-4189-94e0-1442e872fc2d'} Jun 30 10:41:58.788256 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:41:58.788256 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:41:58.788256 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 10:41:58.788256 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 10:41:58.788256 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 10:41:58.788256 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 10:41:58.788256 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 10:41:58.788256 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 10:41:58.788256 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 10:41:58.788256 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 10:41:58.788256 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c8d5bc5-4671-4189-94e0-1442e872fc2d could not be found. Jun 30 10:41:58.788256 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:41:58.788256 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:41:58.788256 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:41:58.788256 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:41:58.788256 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:41:58.788256 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:41:58.788256 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:41:58.788256 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:41:58.788256 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:41:58.789446 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:41:58.789446 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 10:41:58.789446 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 10:41:58.789446 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 10:41:58.789446 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 10:41:58.789446 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 10:41:58.789446 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 10:41:58.789446 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 10:41:58.789446 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:41:58.789446 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c8d5bc5-4671-4189-94e0-1442e872fc2d could not be found. Jun 30 10:41:58.789446 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:41:58.789446 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:41:58.789446 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:41:58.789446 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:41:58.789446 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:41:58.789446 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:41:58.789446 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:41:58.789446 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:41:58.789446 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c8d5bc5-4671-4189-94e0-1442e872fc2d could not be found. Jun 30 10:41:58.789446 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:41:58.790726 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-115803e9-f530-490f-8cd2-0b553c7df21a tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Returning 404 to user: Instance 5c8d5bc5-4671-4189-94e0-1442e872fc2d could not be found. {{(pid=124203) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:41:58.790726 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-115803e9-f530-490f-8cd2-0b553c7df21a tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] 10.222.0.59 "DELETE /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d" status: 404 len: 111 microversion: 2.1 time: 0.028814 Jun 30 10:41:58.790726 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 200/392] 10.222.0.59 () {58 vars in 1238 bytes} [Thu Jun 30 10:41:58 2022] DELETE /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 10:41:58.796602 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-65f75de5-6f89-40ab-806d-377787160db0 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:58.797211 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-65f75de5-6f89-40ab-806d-377787160db0 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] [instance: 5c8d5bc5-4671-4189-94e0-1442e872fc2d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:58.803828 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-65f75de5-6f89-40ab-806d-377787160db0 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:58.804267 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-65f75de5-6f89-40ab-806d-377787160db0 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:58.805121 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-65f75de5-6f89-40ab-806d-377787160db0 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:58.805559 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-65f75de5-6f89-40ab-806d-377787160db0 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:58.818999 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.wsgi [None req-65f75de5-6f89-40ab-806d-377787160db0 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] HTTP exception thrown: Instance 5c8d5bc5-4671-4189-94e0-1442e872fc2d could not be found. Jun 30 10:41:58.820498 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-65f75de5-6f89-40ab-806d-377787160db0 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Request method failure captured: Jun 30 10:41:58.820498 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: request: GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d HTTP/1.1 Jun 30 10:41:58.820498 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Accept: application/json Jun 30 10:41:58.820498 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Accept-Encoding: identity Jun 30 10:41:58.820498 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Connection: close Jun 30 10:41:58.820498 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Content-Length: 0 Jun 30 10:41:58.820498 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Content-Type: application/json Jun 30 10:41:58.820498 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Host: 10.222.0.59 Jun 30 10:41:58.820498 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Openstack-System-Scope: None Jun 30 10:41:58.820498 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: User-Agent: python-urllib3/1.26.9 Jun 30 10:41:58.820498 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Auth-Token: gAAAAABivX2Nx29dJQn5YAjIG_Xxg_F55cYzgSPDTaqWBpq6ZPwFIf_O8bXwSJZmoGpO_v0mf0ipZyDN1Qfsgdoki9djC8q21ZH9Q2kjJtJaWJokjpuRaExgQODKaAMyfa7IKJ5y2WSh4zIrpMdjecnAw2oI_4rIMu7nlb-iUgl5rfpgeioPPCY Jun 30 10:41:58.820498 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Domain-Id: None Jun 30 10:41:58.820498 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Domain-Name: None Jun 30 10:41:58.820498 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Identity-Status: Confirmed Jun 30 10:41:58.820498 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Is-Admin-Project: True Jun 30 10:41:58.820498 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Domain-Id: default Jun 30 10:41:58.820498 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Domain-Name: Default Jun 30 10:41:58.820498 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Id: ff16d27fbbe7475782fe2202e34aec7f Jun 30 10:41:58.820498 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Name: tempest-DeleteServersTestJSON-459273914 Jun 30 10:41:58.820498 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Role: member,reader Jun 30 10:41:58.820498 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Roles: member,reader Jun 30 10:41:58.821935 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ff16d27fbbe7475782fe2202e34aec7f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ff16d27fbbe7475782fe2202e34aec7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ff16d27fbbe7475782fe2202e34aec7f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ff16d27fbbe7475782fe2202e34aec7f"}]}] Jun 30 10:41:58.821935 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant: tempest-DeleteServersTestJSON-459273914 Jun 30 10:41:58.821935 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant-Id: ff16d27fbbe7475782fe2202e34aec7f Jun 30 10:41:58.821935 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant-Name: tempest-DeleteServersTestJSON-459273914 Jun 30 10:41:58.821935 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User: tempest-DeleteServersTestJSON-459273914-project Jun 30 10:41:58.821935 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Domain-Id: default Jun 30 10:41:58.821935 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Domain-Name: Default Jun 30 10:41:58.821935 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Id: 9ad75a8b887a4a40accb49603f03c8ee Jun 30 10:41:58.821935 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Name: tempest-DeleteServersTestJSON-459273914-project Jun 30 10:41:58.821935 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: method: > Jun 30 10:41:58.821935 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: exception: Instance 5c8d5bc5-4671-4189-94e0-1442e872fc2d could not be found. Jun 30 10:41:58.821935 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: action_args: {'id': '5c8d5bc5-4671-4189-94e0-1442e872fc2d'} Jun 30 10:41:58.822685 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:41:58.822685 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:41:58.822685 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 10:41:58.822685 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 10:41:58.822685 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 10:41:58.822685 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 10:41:58.822685 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 10:41:58.822685 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 10:41:58.822685 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 10:41:58.822685 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 10:41:58.822685 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c8d5bc5-4671-4189-94e0-1442e872fc2d could not be found. Jun 30 10:41:58.822685 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:41:58.822685 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:41:58.822685 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:41:58.822685 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:41:58.822685 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:41:58.822685 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:41:58.822685 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:41:58.822685 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:41:58.822685 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:41:58.823825 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:41:58.823825 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 10:41:58.823825 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 10:41:58.823825 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 10:41:58.823825 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 10:41:58.823825 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 10:41:58.823825 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:41:58.823825 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c8d5bc5-4671-4189-94e0-1442e872fc2d could not be found. Jun 30 10:41:58.823825 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:41:58.823825 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:41:58.823825 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:41:58.823825 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:41:58.823825 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:41:58.823825 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:41:58.823825 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:41:58.823825 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:41:58.823825 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c8d5bc5-4671-4189-94e0-1442e872fc2d could not be found. Jun 30 10:41:58.823825 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:41:58.825070 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-65f75de5-6f89-40ab-806d-377787160db0 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] Returning 404 to user: Instance 5c8d5bc5-4671-4189-94e0-1442e872fc2d could not be found. {{(pid=124204) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:41:58.825070 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-65f75de5-6f89-40ab-806d-377787160db0 tempest-DeleteServersTestJSON-459273914 tempest-DeleteServersTestJSON-459273914-project] 10.222.0.59 "GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d" status: 404 len: 111 microversion: 2.1 time: 0.029238 Jun 30 10:41:58.825070 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 193/393] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:58 2022] GET /compute/v2.1/servers/5c8d5bc5-4671-4189-94e0-1442e872fc2d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 10:41:59.157820 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-6ce3a4e2-033d-4ca5-adfb-68dad35ed051 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:59.158431 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-6ce3a4e2-033d-4ca5-adfb-68dad35ed051 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] [instance: 6be3f98f-ff1d-4e22-8109-756f8c516b08] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:59.165303 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-6ce3a4e2-033d-4ca5-adfb-68dad35ed051 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:59.165753 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-6ce3a4e2-033d-4ca5-adfb-68dad35ed051 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:59.166558 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-6ce3a4e2-033d-4ca5-adfb-68dad35ed051 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:59.166997 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-6ce3a4e2-033d-4ca5-adfb-68dad35ed051 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:59.171244 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_cell1:SELECT=100 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:41:59.235918 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-6ce3a4e2-033d-4ca5-adfb-68dad35ed051 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c0ccbf16fe4a399945aa5ad34754b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ed6f6064a4cd88a03cf97ab7abeae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:59.244726 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-6ce3a4e2-033d-4ca5-adfb-68dad35ed051 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] 10.222.0.59 "GET /compute/v2.1/servers/6be3f98f-ff1d-4e22-8109-756f8c516b08" status: 200 len: 1274 microversion: 2.1 time: 0.090902 Jun 30 10:41:59.265879 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 201/394] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:59 2022] GET /compute/v2.1/servers/6be3f98f-ff1d-4e22-8109-756f8c516b08 => generated 1274 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:41:59.510461 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-bc4b6043-45fd-40cd-a0a7-f10608a6746b tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:41:59.511082 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-bc4b6043-45fd-40cd-a0a7-f10608a6746b tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:41:59.517783 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-bc4b6043-45fd-40cd-a0a7-f10608a6746b tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:59.518255 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-bc4b6043-45fd-40cd-a0a7-f10608a6746b tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:59.519767 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-bc4b6043-45fd-40cd-a0a7-f10608a6746b tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:41:59.520246 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-bc4b6043-45fd-40cd-a0a7-f10608a6746b tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:41:59.649638 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-bc4b6043-45fd-40cd-a0a7-f10608a6746b tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:41:59.658309 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-bc4b6043-45fd-40cd-a0a7-f10608a6746b tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1520 microversion: 2.1 time: 0.152173 Jun 30 10:41:59.658984 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 194/395] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:41:59 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:42:00.276364 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-d6cfab5b-942c-44bb-8cd7-b165f8a1ef2f tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:42:00.277286 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-d6cfab5b-942c-44bb-8cd7-b165f8a1ef2f tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] [instance: 6be3f98f-ff1d-4e22-8109-756f8c516b08] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:42:00.283243 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-d6cfab5b-942c-44bb-8cd7-b165f8a1ef2f tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:00.283760 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-d6cfab5b-942c-44bb-8cd7-b165f8a1ef2f tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:00.284644 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-d6cfab5b-942c-44bb-8cd7-b165f8a1ef2f tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:00.285142 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-d6cfab5b-942c-44bb-8cd7-b165f8a1ef2f tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:00.351843 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-d6cfab5b-942c-44bb-8cd7-b165f8a1ef2f tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c0ccbf16fe4a399945aa5ad34754b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ed6f6064a4cd88a03cf97ab7abeae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:42:00.359882 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-d6cfab5b-942c-44bb-8cd7-b165f8a1ef2f tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] 10.222.0.59 "GET /compute/v2.1/servers/6be3f98f-ff1d-4e22-8109-756f8c516b08" status: 200 len: 1272 microversion: 2.1 time: 0.087528 Jun 30 10:42:00.360824 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 202/396] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:42:00 2022] GET /compute/v2.1/servers/6be3f98f-ff1d-4e22-8109-756f8c516b08 => generated 1272 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:42:00.676913 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-d91fc7d7-6358-4292-814b-511159a68428 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:42:00.677620 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-d91fc7d7-6358-4292-814b-511159a68428 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:42:00.684417 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d91fc7d7-6358-4292-814b-511159a68428 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:00.685086 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d91fc7d7-6358-4292-814b-511159a68428 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:00.686304 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d91fc7d7-6358-4292-814b-511159a68428 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:00.686903 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d91fc7d7-6358-4292-814b-511159a68428 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:00.824655 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-d91fc7d7-6358-4292-814b-511159a68428 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:42:00.832819 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-d91fc7d7-6358-4292-814b-511159a68428 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1520 microversion: 2.1 time: 0.160430 Jun 30 10:42:00.833393 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 195/397] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:42:00 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:42:01.376624 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-56a23dee-01d2-4b29-8077-b95f943cab4f tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:42:01.377831 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-56a23dee-01d2-4b29-8077-b95f943cab4f tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] [instance: 6be3f98f-ff1d-4e22-8109-756f8c516b08] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:42:01.384189 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-56a23dee-01d2-4b29-8077-b95f943cab4f tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:01.385504 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-56a23dee-01d2-4b29-8077-b95f943cab4f tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:01.386280 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-56a23dee-01d2-4b29-8077-b95f943cab4f tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:01.386874 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-56a23dee-01d2-4b29-8077-b95f943cab4f tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:01.641257 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [req-2a108b1f-5456-4854-a7de-ca82193667ec req-24efadfa-7ce1-41f4-8b1f-3cf4af5ed5ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6be3f98f-ff1d-4e22-8109-756f8c516b08", "tag": "6e7c50ca-42fc-4e86-8bc1-e391b874958d"}]} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:42:01.670456 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-2a108b1f-5456-4854-a7de-ca82193667ec req-24efadfa-7ce1-41f4-8b1f-3cf4af5ed5ca service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:01.673003 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-2a108b1f-5456-4854-a7de-ca82193667ec req-24efadfa-7ce1-41f4-8b1f-3cf4af5ed5ca service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:01.690476 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.compute.server_external_events [req-2a108b1f-5456-4854-a7de-ca82193667ec req-24efadfa-7ce1-41f4-8b1f-3cf4af5ed5ca service nova] Creating event network-changed:6e7c50ca-42fc-4e86-8bc1-e391b874958d for instance 6be3f98f-ff1d-4e22-8109-756f8c516b08 on hv-cinder-82282 Jun 30 10:42:01.696986 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [req-2a108b1f-5456-4854-a7de-ca82193667ec req-24efadfa-7ce1-41f4-8b1f-3cf4af5ed5ca service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062659 Jun 30 10:42:01.697940 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 196/398] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:42:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 10:42:01.807287 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-56a23dee-01d2-4b29-8077-b95f943cab4f tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c0ccbf16fe4a399945aa5ad34754b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ed6f6064a4cd88a03cf97ab7abeae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:42:01.822811 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-56a23dee-01d2-4b29-8077-b95f943cab4f tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] 10.222.0.59 "GET /compute/v2.1/servers/6be3f98f-ff1d-4e22-8109-756f8c516b08" status: 200 len: 1314 microversion: 2.1 time: 0.450007 Jun 30 10:42:01.824857 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 203/399] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:42:01 2022] GET /compute/v2.1/servers/6be3f98f-ff1d-4e22-8109-756f8c516b08 => generated 1314 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:42:01.852282 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-eb99bca0-e0ab-4ddd-b378-3ccf9a6c356d tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:42:01.853910 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-eb99bca0-e0ab-4ddd-b378-3ccf9a6c356d tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:42:01.860985 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-eb99bca0-e0ab-4ddd-b378-3ccf9a6c356d tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:01.861650 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-eb99bca0-e0ab-4ddd-b378-3ccf9a6c356d tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:01.863771 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-eb99bca0-e0ab-4ddd-b378-3ccf9a6c356d tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:01.864473 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-eb99bca0-e0ab-4ddd-b378-3ccf9a6c356d tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:02.147700 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-eb99bca0-e0ab-4ddd-b378-3ccf9a6c356d tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:42:02.155358 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-eb99bca0-e0ab-4ddd-b378-3ccf9a6c356d tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1520 microversion: 2.1 time: 0.310012 Jun 30 10:42:02.156107 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 197/400] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:42:01 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1520 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:42:02.840709 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-b5796937-5889-4924-a93f-1bcf52cf173b tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:42:02.841851 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-b5796937-5889-4924-a93f-1bcf52cf173b tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] [instance: 6be3f98f-ff1d-4e22-8109-756f8c516b08] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:42:02.848657 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b5796937-5889-4924-a93f-1bcf52cf173b tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:02.849132 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b5796937-5889-4924-a93f-1bcf52cf173b tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:02.849928 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b5796937-5889-4924-a93f-1bcf52cf173b tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:02.850331 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b5796937-5889-4924-a93f-1bcf52cf173b tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:02.992771 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-b5796937-5889-4924-a93f-1bcf52cf173b tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c0ccbf16fe4a399945aa5ad34754b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ed6f6064a4cd88a03cf97ab7abeae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:42:03.004037 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-b5796937-5889-4924-a93f-1bcf52cf173b tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] 10.222.0.59 "GET /compute/v2.1/servers/6be3f98f-ff1d-4e22-8109-756f8c516b08" status: 200 len: 1314 microversion: 2.1 time: 0.167316 Jun 30 10:42:03.004655 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 204/401] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:42:02 2022] GET /compute/v2.1/servers/6be3f98f-ff1d-4e22-8109-756f8c516b08 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:42:03.172400 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-7a36eb43-541b-44a7-9ba4-0f0ab19b1c0f tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:42:03.173231 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-7a36eb43-541b-44a7-9ba4-0f0ab19b1c0f tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:42:03.185784 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:42:03.195955 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-7a36eb43-541b-44a7-9ba4-0f0ab19b1c0f tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:03.196632 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-7a36eb43-541b-44a7-9ba4-0f0ab19b1c0f tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:03.197419 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-7a36eb43-541b-44a7-9ba4-0f0ab19b1c0f tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:03.198066 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-7a36eb43-541b-44a7-9ba4-0f0ab19b1c0f tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:03.383909 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-7a36eb43-541b-44a7-9ba4-0f0ab19b1c0f tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:42:03.393653 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-7a36eb43-541b-44a7-9ba4-0f0ab19b1c0f tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1520 microversion: 2.1 time: 0.224846 Jun 30 10:42:03.395387 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 198/402] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:42:03 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1520 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:42:04.021017 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-0db3b551-1973-4429-a811-a7b40f0dbb80 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:42:04.021635 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-0db3b551-1973-4429-a811-a7b40f0dbb80 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] [instance: 6be3f98f-ff1d-4e22-8109-756f8c516b08] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:42:04.027748 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0db3b551-1973-4429-a811-a7b40f0dbb80 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:04.028187 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0db3b551-1973-4429-a811-a7b40f0dbb80 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:04.028971 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0db3b551-1973-4429-a811-a7b40f0dbb80 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:04.029404 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0db3b551-1973-4429-a811-a7b40f0dbb80 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:04.169300 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-0db3b551-1973-4429-a811-a7b40f0dbb80 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c0ccbf16fe4a399945aa5ad34754b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ed6f6064a4cd88a03cf97ab7abeae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:42:04.178201 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-0db3b551-1973-4429-a811-a7b40f0dbb80 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] 10.222.0.59 "GET /compute/v2.1/servers/6be3f98f-ff1d-4e22-8109-756f8c516b08" status: 200 len: 1314 microversion: 2.1 time: 0.161464 Jun 30 10:42:04.178787 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 205/403] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:42:04 2022] GET /compute/v2.1/servers/6be3f98f-ff1d-4e22-8109-756f8c516b08 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:42:04.414256 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-eb5d4143-1e0b-4f1d-a975-864b5acc4939 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:42:04.414889 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-eb5d4143-1e0b-4f1d-a975-864b5acc4939 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:42:04.422230 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-eb5d4143-1e0b-4f1d-a975-864b5acc4939 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:04.422683 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-eb5d4143-1e0b-4f1d-a975-864b5acc4939 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:04.423611 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-eb5d4143-1e0b-4f1d-a975-864b5acc4939 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:04.424172 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-eb5d4143-1e0b-4f1d-a975-864b5acc4939 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:04.563280 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-eb5d4143-1e0b-4f1d-a975-864b5acc4939 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:42:04.571120 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-eb5d4143-1e0b-4f1d-a975-864b5acc4939 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1520 microversion: 2.1 time: 0.164551 Jun 30 10:42:04.571825 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 199/404] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:42:04 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:42:05.195179 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-cddaa13b-a9af-480d-b206-bbebc097da7c tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:42:05.195884 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-cddaa13b-a9af-480d-b206-bbebc097da7c tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] [instance: 6be3f98f-ff1d-4e22-8109-756f8c516b08] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:42:05.201899 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-cddaa13b-a9af-480d-b206-bbebc097da7c tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:05.202339 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-cddaa13b-a9af-480d-b206-bbebc097da7c tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:05.203111 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-cddaa13b-a9af-480d-b206-bbebc097da7c tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:05.203540 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-cddaa13b-a9af-480d-b206-bbebc097da7c tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:05.351434 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-cddaa13b-a9af-480d-b206-bbebc097da7c tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c0ccbf16fe4a399945aa5ad34754b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ed6f6064a4cd88a03cf97ab7abeae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:42:05.359522 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-cddaa13b-a9af-480d-b206-bbebc097da7c tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] 10.222.0.59 "GET /compute/v2.1/servers/6be3f98f-ff1d-4e22-8109-756f8c516b08" status: 200 len: 1314 microversion: 2.1 time: 0.168161 Jun 30 10:42:05.360101 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 206/405] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:42:05 2022] GET /compute/v2.1/servers/6be3f98f-ff1d-4e22-8109-756f8c516b08 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:42:05.588906 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-fbe84d66-26ba-4de9-adde-5b0f173cac58 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:42:05.589419 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-fbe84d66-26ba-4de9-adde-5b0f173cac58 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:42:05.595879 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-fbe84d66-26ba-4de9-adde-5b0f173cac58 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:05.596317 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-fbe84d66-26ba-4de9-adde-5b0f173cac58 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:05.597711 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-fbe84d66-26ba-4de9-adde-5b0f173cac58 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:05.598163 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-fbe84d66-26ba-4de9-adde-5b0f173cac58 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:05.725525 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-fbe84d66-26ba-4de9-adde-5b0f173cac58 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:42:05.733368 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-fbe84d66-26ba-4de9-adde-5b0f173cac58 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1520 microversion: 2.1 time: 0.148460 Jun 30 10:42:05.733949 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 200/406] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:42:05 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:42:06.377264 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-80479b86-470e-436d-ae6e-3fdeaeea70a4 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:42:06.378553 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-80479b86-470e-436d-ae6e-3fdeaeea70a4 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] [instance: 6be3f98f-ff1d-4e22-8109-756f8c516b08] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:42:06.385304 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-80479b86-470e-436d-ae6e-3fdeaeea70a4 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:06.385758 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-80479b86-470e-436d-ae6e-3fdeaeea70a4 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:06.386528 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-80479b86-470e-436d-ae6e-3fdeaeea70a4 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:06.386966 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-80479b86-470e-436d-ae6e-3fdeaeea70a4 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:06.519706 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-80479b86-470e-436d-ae6e-3fdeaeea70a4 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c0ccbf16fe4a399945aa5ad34754b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ed6f6064a4cd88a03cf97ab7abeae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:42:06.527113 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-80479b86-470e-436d-ae6e-3fdeaeea70a4 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] 10.222.0.59 "GET /compute/v2.1/servers/6be3f98f-ff1d-4e22-8109-756f8c516b08" status: 200 len: 1314 microversion: 2.1 time: 0.154323 Jun 30 10:42:06.527677 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 207/407] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:42:06 2022] GET /compute/v2.1/servers/6be3f98f-ff1d-4e22-8109-756f8c516b08 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:42:06.750799 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-6492a632-9aa3-4027-87d9-07aa5d4d0309 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:42:06.751413 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-6492a632-9aa3-4027-87d9-07aa5d4d0309 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:42:06.758507 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6492a632-9aa3-4027-87d9-07aa5d4d0309 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:06.758954 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6492a632-9aa3-4027-87d9-07aa5d4d0309 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:06.759718 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6492a632-9aa3-4027-87d9-07aa5d4d0309 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:06.760153 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6492a632-9aa3-4027-87d9-07aa5d4d0309 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:06.764100 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_cell1:SELECT=100 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:42:06.887410 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-6492a632-9aa3-4027-87d9-07aa5d4d0309 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:42:06.895146 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-6492a632-9aa3-4027-87d9-07aa5d4d0309 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1520 microversion: 2.1 time: 0.148207 Jun 30 10:42:06.895711 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 201/408] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:42:06 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:42:07.141255 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-13f7c1bf-b52f-40e5-87ed-c5cbfa533dc2 tempest-VolumesTestJSON-440055752 tempest-VolumesTestJSON-440055752-project] Calling method '.version_select at 0x7f4dadf1bc10>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:42:07.188037 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-13f7c1bf-b52f-40e5-87ed-c5cbfa533dc2 tempest-VolumesTestJSON-440055752 tempest-VolumesTestJSON-440055752-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/aec935cc-8f36-40f8-abe6-92fd3a66f67c" status: 200 len: 350 microversion: 2.1 time: 0.050460 Jun 30 10:42:07.188655 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 208/409] 10.222.0.59 () {58 vars in 1244 bytes} [Thu Jun 30 10:42:07 2022] GET /compute/v2.1/os-volumes/aec935cc-8f36-40f8-abe6-92fd3a66f67c => generated 350 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:42:07.543715 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-5d34bd9f-f8fd-484d-a241-289970eb62fa tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:42:07.544338 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-5d34bd9f-f8fd-484d-a241-289970eb62fa tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] [instance: 6be3f98f-ff1d-4e22-8109-756f8c516b08] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:42:07.550397 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5d34bd9f-f8fd-484d-a241-289970eb62fa tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:07.550839 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5d34bd9f-f8fd-484d-a241-289970eb62fa tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:07.551593 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5d34bd9f-f8fd-484d-a241-289970eb62fa tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:07.552043 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5d34bd9f-f8fd-484d-a241-289970eb62fa tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:07.682174 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-5d34bd9f-f8fd-484d-a241-289970eb62fa tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c0ccbf16fe4a399945aa5ad34754b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ed6f6064a4cd88a03cf97ab7abeae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:42:07.689650 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-5d34bd9f-f8fd-484d-a241-289970eb62fa tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] 10.222.0.59 "GET /compute/v2.1/servers/6be3f98f-ff1d-4e22-8109-756f8c516b08" status: 200 len: 1314 microversion: 2.1 time: 0.149880 Jun 30 10:42:07.690206 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 202/410] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:42:07 2022] GET /compute/v2.1/servers/6be3f98f-ff1d-4e22-8109-756f8c516b08 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:42:07.912750 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-c77e6d45-fe39-4a83-98c4-d62a8768c6ea tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:42:07.913533 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-c77e6d45-fe39-4a83-98c4-d62a8768c6ea tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:42:07.920987 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c77e6d45-fe39-4a83-98c4-d62a8768c6ea tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:07.921530 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c77e6d45-fe39-4a83-98c4-d62a8768c6ea tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:07.922386 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c77e6d45-fe39-4a83-98c4-d62a8768c6ea tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:07.922832 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c77e6d45-fe39-4a83-98c4-d62a8768c6ea tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:08.081977 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-c77e6d45-fe39-4a83-98c4-d62a8768c6ea tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:42:08.090432 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-c77e6d45-fe39-4a83-98c4-d62a8768c6ea tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1520 microversion: 2.1 time: 0.182981 Jun 30 10:42:08.091089 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 209/411] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:42:07 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:42:08.707544 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-0e7ab615-0d15-4587-a56a-0315ff2fb393 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:42:08.711389 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-0e7ab615-0d15-4587-a56a-0315ff2fb393 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] [instance: 6be3f98f-ff1d-4e22-8109-756f8c516b08] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:42:08.713843 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_cell0:SELECT=2 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:42:08.714496 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_cell0:SELECT=6 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:42:08.722561 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-0e7ab615-0d15-4587-a56a-0315ff2fb393 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:08.723006 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-0e7ab615-0d15-4587-a56a-0315ff2fb393 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:08.723783 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-0e7ab615-0d15-4587-a56a-0315ff2fb393 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:08.724217 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-0e7ab615-0d15-4587-a56a-0315ff2fb393 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:08.870709 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-0e7ab615-0d15-4587-a56a-0315ff2fb393 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c0ccbf16fe4a399945aa5ad34754b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ed6f6064a4cd88a03cf97ab7abeae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:42:08.878550 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-0e7ab615-0d15-4587-a56a-0315ff2fb393 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] 10.222.0.59 "GET /compute/v2.1/servers/6be3f98f-ff1d-4e22-8109-756f8c516b08" status: 200 len: 1314 microversion: 2.1 time: 0.175502 Jun 30 10:42:08.879188 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 203/412] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:42:08 2022] GET /compute/v2.1/servers/6be3f98f-ff1d-4e22-8109-756f8c516b08 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:42:09.107321 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-cd4c21e3-c0eb-4520-a441-c16013976c3d tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:42:09.107926 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-cd4c21e3-c0eb-4520-a441-c16013976c3d tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:42:09.109801 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_cell0:SELECT=2 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:42:09.110462 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:42:09.116738 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-cd4c21e3-c0eb-4520-a441-c16013976c3d tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:09.117191 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-cd4c21e3-c0eb-4520-a441-c16013976c3d tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:09.117955 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-cd4c21e3-c0eb-4520-a441-c16013976c3d tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:09.118394 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-cd4c21e3-c0eb-4520-a441-c16013976c3d tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:09.254567 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-cd4c21e3-c0eb-4520-a441-c16013976c3d tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:42:09.264525 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-cd4c21e3-c0eb-4520-a441-c16013976c3d tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1520 microversion: 2.1 time: 0.161229 Jun 30 10:42:09.265113 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 210/413] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:42:09 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:42:09.581957 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-e84e1d34-5fa8-49aa-b6aa-91243287459c tempest-VolumesTestJSON-440055752 tempest-VolumesTestJSON-440055752-project] Calling method '.version_select at 0x7f4dae0a9940>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:42:09.635905 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-e84e1d34-5fa8-49aa-b6aa-91243287459c tempest-VolumesTestJSON-440055752 tempest-VolumesTestJSON-440055752-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/cf0612d1-caa5-4f5b-8a6e-f876c027901e" status: 200 len: 349 microversion: 2.1 time: 0.057702 Jun 30 10:42:09.636478 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 204/414] 10.222.0.59 () {58 vars in 1244 bytes} [Thu Jun 30 10:42:09 2022] GET /compute/v2.1/os-volumes/cf0612d1-caa5-4f5b-8a6e-f876c027901e => generated 349 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:42:09.895389 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-c2c68816-de64-46cd-8dfe-711d2d10280f tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:42:09.896202 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-c2c68816-de64-46cd-8dfe-711d2d10280f tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] [instance: 6be3f98f-ff1d-4e22-8109-756f8c516b08] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:42:09.903001 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c2c68816-de64-46cd-8dfe-711d2d10280f tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:09.903514 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c2c68816-de64-46cd-8dfe-711d2d10280f tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:09.904338 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c2c68816-de64-46cd-8dfe-711d2d10280f tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:09.904825 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c2c68816-de64-46cd-8dfe-711d2d10280f tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:10.035410 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-c2c68816-de64-46cd-8dfe-711d2d10280f tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c0ccbf16fe4a399945aa5ad34754b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ed6f6064a4cd88a03cf97ab7abeae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:42:10.042754 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-c2c68816-de64-46cd-8dfe-711d2d10280f tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] 10.222.0.59 "GET /compute/v2.1/servers/6be3f98f-ff1d-4e22-8109-756f8c516b08" status: 200 len: 1314 microversion: 2.1 time: 0.151485 Jun 30 10:42:10.043320 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 211/415] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:42:09 2022] GET /compute/v2.1/servers/6be3f98f-ff1d-4e22-8109-756f8c516b08 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:42:10.282465 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-e1dfddc1-9e72-43ef-8e93-662449c7d748 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:42:10.283034 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-e1dfddc1-9e72-43ef-8e93-662449c7d748 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:42:10.289945 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-e1dfddc1-9e72-43ef-8e93-662449c7d748 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:10.290497 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-e1dfddc1-9e72-43ef-8e93-662449c7d748 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:10.291263 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-e1dfddc1-9e72-43ef-8e93-662449c7d748 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:10.291699 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-e1dfddc1-9e72-43ef-8e93-662449c7d748 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:10.428430 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-e1dfddc1-9e72-43ef-8e93-662449c7d748 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:42:10.436070 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-e1dfddc1-9e72-43ef-8e93-662449c7d748 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1520 microversion: 2.1 time: 0.158077 Jun 30 10:42:10.436679 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 205/416] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:42:10 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:42:10.527056 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [req-ec13c2f0-8dc8-4fb9-9ca8-5619989eed30 req-ff8b5fb0-cb3f-45ba-9127-e6b2ad5f2e02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6be3f98f-ff1d-4e22-8109-756f8c516b08", "name": "network-vif-plugged", "status": "completed", "tag": "6e7c50ca-42fc-4e86-8bc1-e391b874958d"}]} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:42:10.537752 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-ec13c2f0-8dc8-4fb9-9ca8-5619989eed30 req-ff8b5fb0-cb3f-45ba-9127-e6b2ad5f2e02 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:10.538205 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-ec13c2f0-8dc8-4fb9-9ca8-5619989eed30 req-ff8b5fb0-cb3f-45ba-9127-e6b2ad5f2e02 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:10.552131 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.compute.server_external_events [req-ec13c2f0-8dc8-4fb9-9ca8-5619989eed30 req-ff8b5fb0-cb3f-45ba-9127-e6b2ad5f2e02 service nova] Creating event network-vif-plugged:6e7c50ca-42fc-4e86-8bc1-e391b874958d for instance 6be3f98f-ff1d-4e22-8109-756f8c516b08 on hv-cinder-82282 Jun 30 10:42:10.557391 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [req-ec13c2f0-8dc8-4fb9-9ca8-5619989eed30 req-ff8b5fb0-cb3f-45ba-9127-e6b2ad5f2e02 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035119 Jun 30 10:42:10.558355 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 212/417] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:42:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:42:11.060142 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-5dd2954b-ce57-47c5-b6bc-f33f15914c9c tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:42:11.060776 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-5dd2954b-ce57-47c5-b6bc-f33f15914c9c tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] [instance: 6be3f98f-ff1d-4e22-8109-756f8c516b08] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:42:11.067444 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5dd2954b-ce57-47c5-b6bc-f33f15914c9c tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:11.067885 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5dd2954b-ce57-47c5-b6bc-f33f15914c9c tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:11.068682 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5dd2954b-ce57-47c5-b6bc-f33f15914c9c tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:11.069113 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5dd2954b-ce57-47c5-b6bc-f33f15914c9c tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:11.207699 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-5dd2954b-ce57-47c5-b6bc-f33f15914c9c tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c0ccbf16fe4a399945aa5ad34754b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ed6f6064a4cd88a03cf97ab7abeae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:42:11.215169 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-5dd2954b-ce57-47c5-b6bc-f33f15914c9c tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] 10.222.0.59 "GET /compute/v2.1/servers/6be3f98f-ff1d-4e22-8109-756f8c516b08" status: 200 len: 1314 microversion: 2.1 time: 0.158970 Jun 30 10:42:11.215735 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 206/418] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:42:11 2022] GET /compute/v2.1/servers/6be3f98f-ff1d-4e22-8109-756f8c516b08 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:42:11.453770 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-0cf5368b-ce94-4740-9ae2-cc092d98665a tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:42:11.454375 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-0cf5368b-ce94-4740-9ae2-cc092d98665a tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:42:11.460528 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0cf5368b-ce94-4740-9ae2-cc092d98665a tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:11.460976 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0cf5368b-ce94-4740-9ae2-cc092d98665a tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:11.461729 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0cf5368b-ce94-4740-9ae2-cc092d98665a tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:11.462161 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0cf5368b-ce94-4740-9ae2-cc092d98665a tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:11.594390 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-0cf5368b-ce94-4740-9ae2-cc092d98665a tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:42:11.603790 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-0cf5368b-ce94-4740-9ae2-cc092d98665a tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1520 microversion: 2.1 time: 0.154291 Jun 30 10:42:11.604367 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 213/419] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:42:11 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:42:11.996275 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-df7da774-082b-4c0a-be68-57b97682b0f1 tempest-VolumesTestJSON-440055752 tempest-VolumesTestJSON-440055752-project] Calling method '.version_select at 0x7f4dae05bb80>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:42:12.042630 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-df7da774-082b-4c0a-be68-57b97682b0f1 tempest-VolumesTestJSON-440055752 tempest-VolumesTestJSON-440055752-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/69713859-a6ce-4fd9-a4fb-b7cbdfe1c8c3" status: 200 len: 351 microversion: 2.1 time: 0.050078 Jun 30 10:42:12.043157 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 207/420] 10.222.0.59 () {58 vars in 1244 bytes} [Thu Jun 30 10:42:11 2022] GET /compute/v2.1/os-volumes/69713859-a6ce-4fd9-a4fb-b7cbdfe1c8c3 => generated 351 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:42:12.054232 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-6dd41d05-72d0-4e98-b540-b1b679368e24 tempest-VolumesTestJSON-440055752 tempest-VolumesTestJSON-440055752-project] Calling method '.version_select at 0x7f4dae032700>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:42:12.134338 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-6dd41d05-72d0-4e98-b540-b1b679368e24 tempest-VolumesTestJSON-440055752 tempest-VolumesTestJSON-440055752-project] 10.222.0.59 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.083829 Jun 30 10:42:12.134911 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 214/421] 10.222.0.59 () {58 vars in 1133 bytes} [Thu Jun 30 10:42:12 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:42:12.147176 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-784012c4-0183-434f-999e-689ac7bc228f tempest-VolumesTestJSON-440055752 tempest-VolumesTestJSON-440055752-project] Calling method '.version_select at 0x7f4dae0504c0>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:42:12.226381 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-784012c4-0183-434f-999e-689ac7bc228f tempest-VolumesTestJSON-440055752 tempest-VolumesTestJSON-440055752-project] 10.222.0.59 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.083370 Jun 30 10:42:12.227119 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 208/422] 10.222.0.59 () {58 vars in 1148 bytes} [Thu Jun 30 10:42:12 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 10:42:12.231303 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-878a2686-0304-4cc6-90e7-bbc896eca050 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:42:12.231918 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-878a2686-0304-4cc6-90e7-bbc896eca050 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] [instance: 6be3f98f-ff1d-4e22-8109-756f8c516b08] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:42:12.238361 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-878a2686-0304-4cc6-90e7-bbc896eca050 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:12.238504 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-95de826e-9ddd-4573-a2c5-25883984170b tempest-VolumesTestJSON-440055752 tempest-VolumesTestJSON-440055752-project] Calling method '.version_select at 0x7f4dadf68e50>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:42:12.238811 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-878a2686-0304-4cc6-90e7-bbc896eca050 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:12.239579 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-878a2686-0304-4cc6-90e7-bbc896eca050 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:12.240019 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-878a2686-0304-4cc6-90e7-bbc896eca050 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:12.382174 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-878a2686-0304-4cc6-90e7-bbc896eca050 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c0ccbf16fe4a399945aa5ad34754b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ed6f6064a4cd88a03cf97ab7abeae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:42:12.390225 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-878a2686-0304-4cc6-90e7-bbc896eca050 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] 10.222.0.59 "GET /compute/v2.1/servers/6be3f98f-ff1d-4e22-8109-756f8c516b08" status: 200 len: 1314 microversion: 2.1 time: 0.162893 Jun 30 10:42:12.390814 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 215/423] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:42:12 2022] GET /compute/v2.1/servers/6be3f98f-ff1d-4e22-8109-756f8c516b08 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:42:12.449520 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-95de826e-9ddd-4573-a2c5-25883984170b tempest-VolumesTestJSON-440055752 tempest-VolumesTestJSON-440055752-project] 10.222.0.59 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.214592 Jun 30 10:42:12.450092 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 209/424] 10.222.0.59 () {58 vars in 1133 bytes} [Thu Jun 30 10:42:12 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:42:12.461569 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-6eee92ad-fe4b-43c7-bc59-154b67fc57ec tempest-VolumesTestJSON-440055752 tempest-VolumesTestJSON-440055752-project] Calling method '.version_select at 0x7f4dadf1bb80>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:42:12.539947 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-6eee92ad-fe4b-43c7-bc59-154b67fc57ec tempest-VolumesTestJSON-440055752 tempest-VolumesTestJSON-440055752-project] 10.222.0.59 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.082016 Jun 30 10:42:12.540532 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 216/425] 10.222.0.59 () {58 vars in 1166 bytes} [Thu Jun 30 10:42:12 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:42:12.552759 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-fd99d9f0-fb12-4c2a-80e6-3ade9620478c tempest-VolumesTestJSON-440055752 tempest-VolumesTestJSON-440055752-project] Calling method '.version_select at 0x7f4dae05b4c0>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:42:12.623484 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-f449aef0-f659-4264-99c1-699eb5e8c2f2 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:42:12.624393 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-f449aef0-f659-4264-99c1-699eb5e8c2f2 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:42:12.634385 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-f449aef0-f659-4264-99c1-699eb5e8c2f2 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:12.634645 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-fd99d9f0-fb12-4c2a-80e6-3ade9620478c tempest-VolumesTestJSON-440055752 tempest-VolumesTestJSON-440055752-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.086408 Jun 30 10:42:12.636010 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-f449aef0-f659-4264-99c1-699eb5e8c2f2 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:12.636822 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-f449aef0-f659-4264-99c1-699eb5e8c2f2 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:12.637283 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-f449aef0-f659-4264-99c1-699eb5e8c2f2 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:12.641332 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 210/426] 10.222.0.59 () {58 vars in 1169 bytes} [Thu Jun 30 10:42:12 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:42:12.652978 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-f583c93d-d7bb-420b-ab13-f1a1a63060c4 tempest-VolumesTestJSON-440055752 tempest-VolumesTestJSON-440055752-project] Calling method '.version_select at 0x7f4dae0a9700>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:42:12.743642 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-f583c93d-d7bb-420b-ab13-f1a1a63060c4 tempest-VolumesTestJSON-440055752 tempest-VolumesTestJSON-440055752-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.094748 Jun 30 10:42:12.744359 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 211/427] 10.222.0.59 () {58 vars in 1154 bytes} [Thu Jun 30 10:42:12 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:42:12.761646 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-05e8aa5d-2b95-488f-96ad-bd960e287f1e tempest-VolumesTestJSON-440055752 tempest-VolumesTestJSON-440055752-project] Calling method '.version_select at 0x7f4dadf683a0>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:42:12.810736 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-f449aef0-f659-4264-99c1-699eb5e8c2f2 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:42:12.819478 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-f449aef0-f659-4264-99c1-699eb5e8c2f2 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1520 microversion: 2.1 time: 0.201929 Jun 30 10:42:12.820268 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 217/428] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:42:12 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1520 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:42:12.851939 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-05e8aa5d-2b95-488f-96ad-bd960e287f1e tempest-VolumesTestJSON-440055752 tempest-VolumesTestJSON-440055752-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.098427 Jun 30 10:42:12.852563 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 212/429] 10.222.0.59 () {58 vars in 1187 bytes} [Thu Jun 30 10:42:12 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:42:12.864725 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-e77ee6d5-5da7-4e49-82b6-99367fc4d871 tempest-VolumesTestJSON-440055752 tempest-VolumesTestJSON-440055752-project] Calling method '.version_select at 0x7f4dae16ce50>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:42:13.070848 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-e77ee6d5-5da7-4e49-82b6-99367fc4d871 tempest-VolumesTestJSON-440055752 tempest-VolumesTestJSON-440055752-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.210165 Jun 30 10:42:13.072414 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 218/430] 10.222.0.59 () {58 vars in 1154 bytes} [Thu Jun 30 10:42:12 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:42:13.408124 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-516d31b6-4b92-470d-a997-f703e24210ca tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:42:13.408769 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-516d31b6-4b92-470d-a997-f703e24210ca tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] [instance: 6be3f98f-ff1d-4e22-8109-756f8c516b08] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:42:13.415543 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-516d31b6-4b92-470d-a997-f703e24210ca tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:13.415986 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-516d31b6-4b92-470d-a997-f703e24210ca tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:13.416779 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-516d31b6-4b92-470d-a997-f703e24210ca tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:13.417220 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-516d31b6-4b92-470d-a997-f703e24210ca tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:13.544597 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-516d31b6-4b92-470d-a997-f703e24210ca tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c0ccbf16fe4a399945aa5ad34754b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ed6f6064a4cd88a03cf97ab7abeae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:42:13.551868 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-516d31b6-4b92-470d-a997-f703e24210ca tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] 10.222.0.59 "GET /compute/v2.1/servers/6be3f98f-ff1d-4e22-8109-756f8c516b08" status: 200 len: 1314 microversion: 2.1 time: 0.148068 Jun 30 10:42:13.552433 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 213/431] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:42:13 2022] GET /compute/v2.1/servers/6be3f98f-ff1d-4e22-8109-756f8c516b08 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:42:13.836486 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-f8a298ec-4015-4ee1-865f-b89bb267bd4a tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:42:13.837121 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-f8a298ec-4015-4ee1-865f-b89bb267bd4a tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:42:13.843160 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-f8a298ec-4015-4ee1-865f-b89bb267bd4a tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:13.843613 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-f8a298ec-4015-4ee1-865f-b89bb267bd4a tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:13.844376 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-f8a298ec-4015-4ee1-865f-b89bb267bd4a tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:13.844838 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-f8a298ec-4015-4ee1-865f-b89bb267bd4a tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:13.974769 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-f8a298ec-4015-4ee1-865f-b89bb267bd4a tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:42:13.982468 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-f8a298ec-4015-4ee1-865f-b89bb267bd4a tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1520 microversion: 2.1 time: 0.149823 Jun 30 10:42:13.983030 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 219/432] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:42:13 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:42:14.569012 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-69f400e9-d134-471b-a8e4-10ac39a8b5c2 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:42:14.569621 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-69f400e9-d134-471b-a8e4-10ac39a8b5c2 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] [instance: 6be3f98f-ff1d-4e22-8109-756f8c516b08] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:42:14.576076 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-69f400e9-d134-471b-a8e4-10ac39a8b5c2 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:14.576551 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-69f400e9-d134-471b-a8e4-10ac39a8b5c2 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:14.577316 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-69f400e9-d134-471b-a8e4-10ac39a8b5c2 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:14.577754 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-69f400e9-d134-471b-a8e4-10ac39a8b5c2 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:14.704772 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-69f400e9-d134-471b-a8e4-10ac39a8b5c2 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c0ccbf16fe4a399945aa5ad34754b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ed6f6064a4cd88a03cf97ab7abeae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:42:14.712260 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-69f400e9-d134-471b-a8e4-10ac39a8b5c2 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] 10.222.0.59 "GET /compute/v2.1/servers/6be3f98f-ff1d-4e22-8109-756f8c516b08" status: 200 len: 1314 microversion: 2.1 time: 0.147700 Jun 30 10:42:14.712868 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 214/433] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:42:14 2022] GET /compute/v2.1/servers/6be3f98f-ff1d-4e22-8109-756f8c516b08 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:42:15.000212 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-df94e6d3-f0fd-47ee-93cf-a68a0aef9c22 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:42:15.000858 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-df94e6d3-f0fd-47ee-93cf-a68a0aef9c22 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:42:15.006905 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-df94e6d3-f0fd-47ee-93cf-a68a0aef9c22 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:15.007305 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-df94e6d3-f0fd-47ee-93cf-a68a0aef9c22 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:15.008080 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-df94e6d3-f0fd-47ee-93cf-a68a0aef9c22 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:15.008523 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-df94e6d3-f0fd-47ee-93cf-a68a0aef9c22 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:15.140322 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-df94e6d3-f0fd-47ee-93cf-a68a0aef9c22 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:42:15.148299 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-df94e6d3-f0fd-47ee-93cf-a68a0aef9c22 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1520 microversion: 2.1 time: 0.151979 Jun 30 10:42:15.148906 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 220/434] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:42:14 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:42:15.729939 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-d209f536-bad9-4225-be2a-52675edf59c0 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:42:15.730807 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-d209f536-bad9-4225-be2a-52675edf59c0 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] [instance: 6be3f98f-ff1d-4e22-8109-756f8c516b08] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:42:15.737311 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d209f536-bad9-4225-be2a-52675edf59c0 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:15.737750 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d209f536-bad9-4225-be2a-52675edf59c0 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:15.738495 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d209f536-bad9-4225-be2a-52675edf59c0 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:15.738924 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d209f536-bad9-4225-be2a-52675edf59c0 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:15.883170 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-d209f536-bad9-4225-be2a-52675edf59c0 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c0ccbf16fe4a399945aa5ad34754b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ed6f6064a4cd88a03cf97ab7abeae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:42:15.891375 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-d209f536-bad9-4225-be2a-52675edf59c0 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] 10.222.0.59 "GET /compute/v2.1/servers/6be3f98f-ff1d-4e22-8109-756f8c516b08" status: 200 len: 1314 microversion: 2.1 time: 0.165235 Jun 30 10:42:15.891942 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 215/435] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:42:15 2022] GET /compute/v2.1/servers/6be3f98f-ff1d-4e22-8109-756f8c516b08 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:42:16.164882 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-b0c76e7f-0dec-4d29-8756-2cfa93f7c4c4 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:42:16.165490 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-b0c76e7f-0dec-4d29-8756-2cfa93f7c4c4 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:42:16.171510 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b0c76e7f-0dec-4d29-8756-2cfa93f7c4c4 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:16.171966 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b0c76e7f-0dec-4d29-8756-2cfa93f7c4c4 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:16.172761 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b0c76e7f-0dec-4d29-8756-2cfa93f7c4c4 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:16.173200 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b0c76e7f-0dec-4d29-8756-2cfa93f7c4c4 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:16.303228 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-b0c76e7f-0dec-4d29-8756-2cfa93f7c4c4 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:42:16.310859 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-b0c76e7f-0dec-4d29-8756-2cfa93f7c4c4 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1520 microversion: 2.1 time: 0.149800 Jun 30 10:42:16.311420 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 221/436] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:42:16 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:42:16.910471 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-48376f86-ad12-417b-a136-4d16671f4823 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:42:16.911089 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-48376f86-ad12-417b-a136-4d16671f4823 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] [instance: 6be3f98f-ff1d-4e22-8109-756f8c516b08] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:42:16.917704 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-48376f86-ad12-417b-a136-4d16671f4823 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:16.918152 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-48376f86-ad12-417b-a136-4d16671f4823 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:16.918916 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-48376f86-ad12-417b-a136-4d16671f4823 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:16.919353 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-48376f86-ad12-417b-a136-4d16671f4823 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:17.043909 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-48376f86-ad12-417b-a136-4d16671f4823 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c0ccbf16fe4a399945aa5ad34754b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ed6f6064a4cd88a03cf97ab7abeae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:42:17.052195 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-48376f86-ad12-417b-a136-4d16671f4823 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] 10.222.0.59 "GET /compute/v2.1/servers/6be3f98f-ff1d-4e22-8109-756f8c516b08" status: 200 len: 1498 microversion: 2.1 time: 0.146316 Jun 30 10:42:17.052799 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 216/437] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:42:16 2022] GET /compute/v2.1/servers/6be3f98f-ff1d-4e22-8109-756f8c516b08 => generated 1498 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:42:17.326901 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-c3c8f603-8473-48a9-bdc8-cac719deedb3 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:42:17.327551 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-c3c8f603-8473-48a9-bdc8-cac719deedb3 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:42:17.334116 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c3c8f603-8473-48a9-bdc8-cac719deedb3 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:17.334649 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c3c8f603-8473-48a9-bdc8-cac719deedb3 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:17.335411 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c3c8f603-8473-48a9-bdc8-cac719deedb3 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:17.335850 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c3c8f603-8473-48a9-bdc8-cac719deedb3 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:17.355864 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_cell1:SELECT=100 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:42:17.468367 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-c3c8f603-8473-48a9-bdc8-cac719deedb3 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:42:17.476071 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-c3c8f603-8473-48a9-bdc8-cac719deedb3 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1500 microversion: 2.1 time: 0.152889 Jun 30 10:42:17.480602 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 222/438] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:42:17 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1500 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:42:17.492830 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-8678271f-c20c-49e6-b74f-de0b2b7bb0fb tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:42:17.493452 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-8678271f-c20c-49e6-b74f-de0b2b7bb0fb tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 109c8a70-7b89-45b4-8876-a3286375b27d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:42:17.499721 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-8678271f-c20c-49e6-b74f-de0b2b7bb0fb tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:17.500170 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-8678271f-c20c-49e6-b74f-de0b2b7bb0fb tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:17.500989 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-8678271f-c20c-49e6-b74f-de0b2b7bb0fb tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:17.501417 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-8678271f-c20c-49e6-b74f-de0b2b7bb0fb tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:17.538499 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-b592fa54-6d74-49fc-ad0c-309d6f6441fa tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:42:17.539053 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-b592fa54-6d74-49fc-ad0c-309d6f6441fa tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] [instance: 6be3f98f-ff1d-4e22-8109-756f8c516b08] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:42:17.546963 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b592fa54-6d74-49fc-ad0c-309d6f6441fa tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:17.547656 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b592fa54-6d74-49fc-ad0c-309d6f6441fa tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:17.548415 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b592fa54-6d74-49fc-ad0c-309d6f6441fa tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:17.549034 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b592fa54-6d74-49fc-ad0c-309d6f6441fa tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:17.575829 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-b592fa54-6d74-49fc-ad0c-309d6f6441fa tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] [instance: 6be3f98f-ff1d-4e22-8109-756f8c516b08] Going to try to terminate instance {{(pid=124203) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 10:42:17.652665 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-8678271f-c20c-49e6-b74f-de0b2b7bb0fb tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:42:17.660915 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-8678271f-c20c-49e6-b74f-de0b2b7bb0fb tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d" status: 200 len: 1513 microversion: 2.1 time: 0.172168 Jun 30 10:42:17.664097 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-b592fa54-6d74-49fc-ad0c-309d6f6441fa tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] 10.222.0.59 "DELETE /compute/v2.1/servers/6be3f98f-ff1d-4e22-8109-756f8c516b08" status: 204 len: 0 microversion: 2.1 time: 0.128256 Jun 30 10:42:17.668967 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 223/439] 10.222.0.59 () {58 vars in 1238 bytes} [Thu Jun 30 10:42:17 2022] DELETE /compute/v2.1/servers/6be3f98f-ff1d-4e22-8109-756f8c516b08 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 30 10:42:17.673791 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 217/440] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:42:17 2022] GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d => generated 1513 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:42:17.676736 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-a6139baa-0dfa-474c-8e03-30fef17e5ce8 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:42:17.677493 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-a6139baa-0dfa-474c-8e03-30fef17e5ce8 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] [instance: 6be3f98f-ff1d-4e22-8109-756f8c516b08] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:42:17.684563 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a6139baa-0dfa-474c-8e03-30fef17e5ce8 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:17.685842 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a6139baa-0dfa-474c-8e03-30fef17e5ce8 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:17.686620 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a6139baa-0dfa-474c-8e03-30fef17e5ce8 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:17.687053 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a6139baa-0dfa-474c-8e03-30fef17e5ce8 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:17.830998 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-a6139baa-0dfa-474c-8e03-30fef17e5ce8 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c0ccbf16fe4a399945aa5ad34754b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ed6f6064a4cd88a03cf97ab7abeae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:42:17.840567 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-a6139baa-0dfa-474c-8e03-30fef17e5ce8 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] 10.222.0.59 "GET /compute/v2.1/servers/6be3f98f-ff1d-4e22-8109-756f8c516b08" status: 200 len: 1504 microversion: 2.1 time: 0.168358 Jun 30 10:42:17.851270 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 224/441] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:42:17 2022] GET /compute/v2.1/servers/6be3f98f-ff1d-4e22-8109-756f8c516b08 => generated 1504 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:42:18.858655 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-a6736b5b-f968-49df-8655-5f21e9a5447c tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:42:18.859493 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-a6736b5b-f968-49df-8655-5f21e9a5447c tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] [instance: 6be3f98f-ff1d-4e22-8109-756f8c516b08] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:42:18.866924 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a6736b5b-f968-49df-8655-5f21e9a5447c tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:18.867373 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a6736b5b-f968-49df-8655-5f21e9a5447c tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:18.868161 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a6736b5b-f968-49df-8655-5f21e9a5447c tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:18.868634 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a6736b5b-f968-49df-8655-5f21e9a5447c tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:19.020679 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-a6736b5b-f968-49df-8655-5f21e9a5447c tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c0ccbf16fe4a399945aa5ad34754b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ed6f6064a4cd88a03cf97ab7abeae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:42:19.028754 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-a6736b5b-f968-49df-8655-5f21e9a5447c tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] 10.222.0.59 "GET /compute/v2.1/servers/6be3f98f-ff1d-4e22-8109-756f8c516b08" status: 200 len: 1504 microversion: 2.1 time: 0.173567 Jun 30 10:42:19.029340 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 218/442] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:42:18 2022] GET /compute/v2.1/servers/6be3f98f-ff1d-4e22-8109-756f8c516b08 => generated 1504 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:42:20.047636 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-d071c6ba-9bec-46d2-87c9-b123433fb29a tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:42:20.049025 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-d071c6ba-9bec-46d2-87c9-b123433fb29a tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] [instance: 6be3f98f-ff1d-4e22-8109-756f8c516b08] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:42:20.058898 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-d071c6ba-9bec-46d2-87c9-b123433fb29a tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:20.059699 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-d071c6ba-9bec-46d2-87c9-b123433fb29a tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:20.060708 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-d071c6ba-9bec-46d2-87c9-b123433fb29a tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:20.061311 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-d071c6ba-9bec-46d2-87c9-b123433fb29a tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:20.156180 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-3fbffb85-2705-4875-b8f7-b7bab5070d93 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:42:20.157837 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-3fbffb85-2705-4875-b8f7-b7bab5070d93 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 109c8a70-7b89-45b4-8876-a3286375b27d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:42:20.165279 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-3fbffb85-2705-4875-b8f7-b7bab5070d93 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:20.165928 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-3fbffb85-2705-4875-b8f7-b7bab5070d93 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:20.166852 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-3fbffb85-2705-4875-b8f7-b7bab5070d93 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:20.167427 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-3fbffb85-2705-4875-b8f7-b7bab5070d93 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:20.195251 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.objects.instance [None req-3fbffb85-2705-4875-b8f7-b7bab5070d93 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lazy-loading 'flavor' on Instance uuid 109c8a70-7b89-45b4-8876-a3286375b27d {{(pid=124204) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 10:42:20.282564 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-d071c6ba-9bec-46d2-87c9-b123433fb29a tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c0ccbf16fe4a399945aa5ad34754b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ed6f6064a4cd88a03cf97ab7abeae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:42:20.295831 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-d071c6ba-9bec-46d2-87c9-b123433fb29a tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] 10.222.0.59 "GET /compute/v2.1/servers/6be3f98f-ff1d-4e22-8109-756f8c516b08" status: 200 len: 1504 microversion: 2.1 time: 0.247227 Jun 30 10:42:20.296914 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 225/443] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:42:20 2022] GET /compute/v2.1/servers/6be3f98f-ff1d-4e22-8109-756f8c516b08 => generated 1504 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:42:20.341176 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-3fbffb85-2705-4875-b8f7-b7bab5070d93 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "POST /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d/action" status: 200 len: 32 microversion: 2.1 time: 0.188739 Jun 30 10:42:20.343585 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 219/444] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Jun 30 10:42:20 2022] POST /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d/action => generated 32 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 30 10:42:20.356125 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-c18a0f0e-4862-42f2-916b-cfaa20923e9c tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:42:20.356781 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-c18a0f0e-4862-42f2-916b-cfaa20923e9c tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 109c8a70-7b89-45b4-8876-a3286375b27d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:42:20.374076 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c18a0f0e-4862-42f2-916b-cfaa20923e9c tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:20.379105 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c18a0f0e-4862-42f2-916b-cfaa20923e9c tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:20.382124 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c18a0f0e-4862-42f2-916b-cfaa20923e9c tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:20.382601 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c18a0f0e-4862-42f2-916b-cfaa20923e9c tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:20.385731 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [req-1f9867d6-44a3-4a6a-98e1-ee858f399861 req-ee8eee46-3ee6-45b6-aeed-c7532eaefdcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6be3f98f-ff1d-4e22-8109-756f8c516b08", "name": "network-vif-deleted", "tag": "6e7c50ca-42fc-4e86-8bc1-e391b874958d"}]} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:42:20.415920 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-1f9867d6-44a3-4a6a-98e1-ee858f399861 req-ee8eee46-3ee6-45b6-aeed-c7532eaefdcd service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:20.416332 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-1f9867d6-44a3-4a6a-98e1-ee858f399861 req-ee8eee46-3ee6-45b6-aeed-c7532eaefdcd service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:20.432786 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.compute.server_external_events [req-1f9867d6-44a3-4a6a-98e1-ee858f399861 req-ee8eee46-3ee6-45b6-aeed-c7532eaefdcd service nova] Creating event network-vif-deleted:6e7c50ca-42fc-4e86-8bc1-e391b874958d for instance 6be3f98f-ff1d-4e22-8109-756f8c516b08 on hv-cinder-82282 Jun 30 10:42:20.437587 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [req-1f9867d6-44a3-4a6a-98e1-ee858f399861 req-ee8eee46-3ee6-45b6-aeed-c7532eaefdcd service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069352 Jun 30 10:42:20.438193 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 220/445] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:42:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:42:20.573824 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-c18a0f0e-4862-42f2-916b-cfaa20923e9c tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:42:20.583042 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-c18a0f0e-4862-42f2-916b-cfaa20923e9c tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d" status: 200 len: 1519 microversion: 2.1 time: 0.232600 Jun 30 10:42:20.583857 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 226/446] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:42:20 2022] GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d => generated 1519 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:42:21.314270 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-d34a9724-47bd-4d77-aa00-c8a591898003 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:42:21.314998 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-d34a9724-47bd-4d77-aa00-c8a591898003 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] [instance: 6be3f98f-ff1d-4e22-8109-756f8c516b08] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:42:21.322077 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d34a9724-47bd-4d77-aa00-c8a591898003 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:21.322530 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d34a9724-47bd-4d77-aa00-c8a591898003 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:21.323294 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d34a9724-47bd-4d77-aa00-c8a591898003 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:21.323725 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d34a9724-47bd-4d77-aa00-c8a591898003 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:21.336688 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.wsgi [None req-d34a9724-47bd-4d77-aa00-c8a591898003 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] HTTP exception thrown: Instance 6be3f98f-ff1d-4e22-8109-756f8c516b08 could not be found. Jun 30 10:42:21.338350 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-d34a9724-47bd-4d77-aa00-c8a591898003 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Request method failure captured: Jun 30 10:42:21.338350 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: request: GET /compute/v2.1/servers/6be3f98f-ff1d-4e22-8109-756f8c516b08 HTTP/1.1 Jun 30 10:42:21.338350 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Accept: application/json Jun 30 10:42:21.338350 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Accept-Encoding: identity Jun 30 10:42:21.338350 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Connection: close Jun 30 10:42:21.338350 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Content-Length: 0 Jun 30 10:42:21.338350 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Content-Type: application/json Jun 30 10:42:21.338350 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Host: 10.222.0.59 Jun 30 10:42:21.338350 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Openstack-System-Scope: None Jun 30 10:42:21.338350 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: User-Agent: python-urllib3/1.26.9 Jun 30 10:42:21.338350 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Auth-Token: gAAAAABivX3Aim7t3mGoy3qB9lhBWfpZ0AfKZ_rPrilUCfs_KAIfXHqF9VTg0oSec75SYQzwOzL3G0mKWiFdYHWbA9kOp6iDAAYV5WQCJfhorbl2Nc7ooUDmt9DBc8PUWyH7xS-tGwKLz4AP--nZi5iVQXSALt6SQ0lfyS7gJ-cXDqHnU-DDv-Y Jun 30 10:42:21.338350 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Domain-Id: None Jun 30 10:42:21.338350 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Domain-Name: None Jun 30 10:42:21.338350 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Identity-Status: Confirmed Jun 30 10:42:21.338350 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Is-Admin-Project: True Jun 30 10:42:21.338350 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Domain-Id: default Jun 30 10:42:21.338350 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Domain-Name: Default Jun 30 10:42:21.338350 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Id: d60ed6f6064a4cd88a03cf97ab7abeae Jun 30 10:42:21.338350 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Name: tempest-VolumesActionsTest-848241142 Jun 30 10:42:21.338350 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Role: member,reader Jun 30 10:42:21.338350 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Roles: member,reader Jun 30 10:42:21.339830 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d60ed6f6064a4cd88a03cf97ab7abeae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d60ed6f6064a4cd88a03cf97ab7abeae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d60ed6f6064a4cd88a03cf97ab7abeae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d60ed6f6064a4cd88a03cf97ab7abeae"}]}] Jun 30 10:42:21.339830 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant: tempest-VolumesActionsTest-848241142 Jun 30 10:42:21.339830 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant-Id: d60ed6f6064a4cd88a03cf97ab7abeae Jun 30 10:42:21.339830 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant-Name: tempest-VolumesActionsTest-848241142 Jun 30 10:42:21.339830 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User: tempest-VolumesActionsTest-848241142-project Jun 30 10:42:21.339830 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Domain-Id: default Jun 30 10:42:21.339830 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Domain-Name: Default Jun 30 10:42:21.339830 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Id: f5c0ccbf16fe4a399945aa5ad34754b5 Jun 30 10:42:21.339830 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Name: tempest-VolumesActionsTest-848241142-project Jun 30 10:42:21.339830 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: method: > Jun 30 10:42:21.339830 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: exception: Instance 6be3f98f-ff1d-4e22-8109-756f8c516b08 could not be found. Jun 30 10:42:21.339830 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: action_args: {'id': '6be3f98f-ff1d-4e22-8109-756f8c516b08'} Jun 30 10:42:21.340649 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:42:21.340649 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:42:21.340649 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 10:42:21.340649 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 10:42:21.340649 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 10:42:21.340649 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 10:42:21.340649 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 10:42:21.340649 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 10:42:21.340649 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 10:42:21.340649 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 10:42:21.340649 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6be3f98f-ff1d-4e22-8109-756f8c516b08 could not be found. Jun 30 10:42:21.340649 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:42:21.340649 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:42:21.340649 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:42:21.340649 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:42:21.340649 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:42:21.340649 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:42:21.340649 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:42:21.340649 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:42:21.340649 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:42:21.342038 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:42:21.342038 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 10:42:21.342038 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 10:42:21.342038 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 10:42:21.342038 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 10:42:21.342038 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 10:42:21.342038 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:42:21.342038 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6be3f98f-ff1d-4e22-8109-756f8c516b08 could not be found. Jun 30 10:42:21.342038 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:42:21.342038 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:42:21.342038 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:42:21.342038 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:42:21.342038 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:42:21.342038 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:42:21.342038 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:42:21.342038 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:42:21.342038 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6be3f98f-ff1d-4e22-8109-756f8c516b08 could not be found. Jun 30 10:42:21.342038 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:42:21.343166 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-d34a9724-47bd-4d77-aa00-c8a591898003 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] Returning 404 to user: Instance 6be3f98f-ff1d-4e22-8109-756f8c516b08 could not be found. {{(pid=124204) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:42:21.343166 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-d34a9724-47bd-4d77-aa00-c8a591898003 tempest-VolumesActionsTest-848241142 tempest-VolumesActionsTest-848241142-project] 10.222.0.59 "GET /compute/v2.1/servers/6be3f98f-ff1d-4e22-8109-756f8c516b08" status: 404 len: 111 microversion: 2.1 time: 0.029849 Jun 30 10:42:21.343166 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 221/447] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:42:21 2022] GET /compute/v2.1/servers/6be3f98f-ff1d-4e22-8109-756f8c516b08 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 10:42:21.604894 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-518297e1-2e78-4990-926a-1a5ab0fbf7b9 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:42:21.606798 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-518297e1-2e78-4990-926a-1a5ab0fbf7b9 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 109c8a70-7b89-45b4-8876-a3286375b27d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:42:21.615286 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-518297e1-2e78-4990-926a-1a5ab0fbf7b9 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:21.616014 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-518297e1-2e78-4990-926a-1a5ab0fbf7b9 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:21.617819 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-518297e1-2e78-4990-926a-1a5ab0fbf7b9 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:21.618570 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-518297e1-2e78-4990-926a-1a5ab0fbf7b9 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:21.806338 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-518297e1-2e78-4990-926a-1a5ab0fbf7b9 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:42:21.815074 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-518297e1-2e78-4990-926a-1a5ab0fbf7b9 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d" status: 200 len: 1519 microversion: 2.1 time: 0.218336 Jun 30 10:42:21.823721 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 227/448] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:42:21 2022] GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d => generated 1519 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:42:22.832154 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-756ed796-07f4-4f08-b560-ef6c473bd693 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:42:22.832820 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-756ed796-07f4-4f08-b560-ef6c473bd693 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 109c8a70-7b89-45b4-8876-a3286375b27d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:42:22.839343 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-756ed796-07f4-4f08-b560-ef6c473bd693 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:22.839782 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-756ed796-07f4-4f08-b560-ef6c473bd693 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:22.840553 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-756ed796-07f4-4f08-b560-ef6c473bd693 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:22.840984 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-756ed796-07f4-4f08-b560-ef6c473bd693 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:22.991587 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-756ed796-07f4-4f08-b560-ef6c473bd693 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:42:23.000432 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-756ed796-07f4-4f08-b560-ef6c473bd693 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d" status: 200 len: 1519 microversion: 2.1 time: 0.172474 Jun 30 10:42:23.001125 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 222/449] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:42:22 2022] GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d => generated 1519 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:42:24.017521 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-c0e8b986-5a7c-4751-9bdf-c391abe71c42 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:42:24.018909 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-c0e8b986-5a7c-4751-9bdf-c391abe71c42 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 109c8a70-7b89-45b4-8876-a3286375b27d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:42:24.025755 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c0e8b986-5a7c-4751-9bdf-c391abe71c42 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:24.026273 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c0e8b986-5a7c-4751-9bdf-c391abe71c42 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:24.027042 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c0e8b986-5a7c-4751-9bdf-c391abe71c42 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:24.027477 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c0e8b986-5a7c-4751-9bdf-c391abe71c42 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:24.178879 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-c0e8b986-5a7c-4751-9bdf-c391abe71c42 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:42:24.186942 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-c0e8b986-5a7c-4751-9bdf-c391abe71c42 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d" status: 200 len: 1519 microversion: 2.1 time: 0.173276 Jun 30 10:42:24.187619 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 228/450] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:42:24 2022] GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d => generated 1519 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:42:25.205215 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-e893d9b5-53e4-41c0-ba09-030ef2c39142 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:42:25.206357 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-e893d9b5-53e4-41c0-ba09-030ef2c39142 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 109c8a70-7b89-45b4-8876-a3286375b27d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:42:25.213645 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-e893d9b5-53e4-41c0-ba09-030ef2c39142 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:25.214337 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-e893d9b5-53e4-41c0-ba09-030ef2c39142 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:25.215109 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-e893d9b5-53e4-41c0-ba09-030ef2c39142 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:25.215545 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-e893d9b5-53e4-41c0-ba09-030ef2c39142 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:25.372769 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-e893d9b5-53e4-41c0-ba09-030ef2c39142 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:42:25.381088 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-e893d9b5-53e4-41c0-ba09-030ef2c39142 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d" status: 200 len: 1519 microversion: 2.1 time: 0.179947 Jun 30 10:42:25.381664 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 223/451] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:42:25 2022] GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d => generated 1519 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:42:26.398982 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-06d56111-b6ff-4cfa-8c05-cdd437a914a8 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:42:26.399577 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-06d56111-b6ff-4cfa-8c05-cdd437a914a8 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 109c8a70-7b89-45b4-8876-a3286375b27d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:42:26.405600 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-06d56111-b6ff-4cfa-8c05-cdd437a914a8 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:26.406041 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-06d56111-b6ff-4cfa-8c05-cdd437a914a8 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:26.406784 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-06d56111-b6ff-4cfa-8c05-cdd437a914a8 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:26.407219 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-06d56111-b6ff-4cfa-8c05-cdd437a914a8 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:26.536373 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-06d56111-b6ff-4cfa-8c05-cdd437a914a8 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:42:26.543669 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-06d56111-b6ff-4cfa-8c05-cdd437a914a8 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d" status: 200 len: 1519 microversion: 2.1 time: 0.148583 Jun 30 10:42:26.544226 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 229/452] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:42:26 2022] GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d => generated 1519 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:42:27.560212 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-2c47e77e-67ff-4866-a0df-97d6515e7764 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:42:27.560775 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-2c47e77e-67ff-4866-a0df-97d6515e7764 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 109c8a70-7b89-45b4-8876-a3286375b27d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:42:27.567955 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-2c47e77e-67ff-4866-a0df-97d6515e7764 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:27.568395 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-2c47e77e-67ff-4866-a0df-97d6515e7764 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:27.569176 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-2c47e77e-67ff-4866-a0df-97d6515e7764 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:27.569605 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-2c47e77e-67ff-4866-a0df-97d6515e7764 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:27.573671 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:42:27.698797 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-2c47e77e-67ff-4866-a0df-97d6515e7764 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:42:27.706256 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-2c47e77e-67ff-4866-a0df-97d6515e7764 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d" status: 200 len: 1519 microversion: 2.1 time: 0.149948 Jun 30 10:42:27.706818 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 224/453] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:42:27 2022] GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:42:28.722136 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-e8545dac-fa7c-4129-9381-c60a74c19149 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:42:28.722740 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-e8545dac-fa7c-4129-9381-c60a74c19149 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 109c8a70-7b89-45b4-8876-a3286375b27d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:42:28.728847 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e8545dac-fa7c-4129-9381-c60a74c19149 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:28.729286 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e8545dac-fa7c-4129-9381-c60a74c19149 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:28.730032 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e8545dac-fa7c-4129-9381-c60a74c19149 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:28.730734 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e8545dac-fa7c-4129-9381-c60a74c19149 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:28.857564 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-e8545dac-fa7c-4129-9381-c60a74c19149 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:42:28.864794 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-e8545dac-fa7c-4129-9381-c60a74c19149 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d" status: 200 len: 1519 microversion: 2.1 time: 0.146557 Jun 30 10:42:28.865349 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 230/454] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:42:28 2022] GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d => generated 1519 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:42:29.881610 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-4e44bd7f-6d75-47a2-a70c-dfc88b162271 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:42:29.882208 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-4e44bd7f-6d75-47a2-a70c-dfc88b162271 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 109c8a70-7b89-45b4-8876-a3286375b27d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:42:29.888729 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-4e44bd7f-6d75-47a2-a70c-dfc88b162271 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:29.889171 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-4e44bd7f-6d75-47a2-a70c-dfc88b162271 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:29.889914 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-4e44bd7f-6d75-47a2-a70c-dfc88b162271 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:29.890341 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-4e44bd7f-6d75-47a2-a70c-dfc88b162271 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:30.014784 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-4e44bd7f-6d75-47a2-a70c-dfc88b162271 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:42:30.022130 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-4e44bd7f-6d75-47a2-a70c-dfc88b162271 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d" status: 200 len: 1519 microversion: 2.1 time: 0.145042 Jun 30 10:42:30.022729 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 225/455] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:42:29 2022] GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d => generated 1519 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:42:31.038792 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-a3595171-c142-4509-971a-8ddef4ef43c5 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:42:31.039391 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-a3595171-c142-4509-971a-8ddef4ef43c5 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 109c8a70-7b89-45b4-8876-a3286375b27d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:42:31.045504 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a3595171-c142-4509-971a-8ddef4ef43c5 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:31.045945 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a3595171-c142-4509-971a-8ddef4ef43c5 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:31.046694 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a3595171-c142-4509-971a-8ddef4ef43c5 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:31.047124 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a3595171-c142-4509-971a-8ddef4ef43c5 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:31.173299 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-a3595171-c142-4509-971a-8ddef4ef43c5 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:42:31.180625 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-a3595171-c142-4509-971a-8ddef4ef43c5 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d" status: 200 len: 1519 microversion: 2.1 time: 0.145718 Jun 30 10:42:31.181178 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 231/456] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:42:31 2022] GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d => generated 1519 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:42:32.196946 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-fd3ba73d-5570-46dd-817e-d7786320ae57 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:42:32.197681 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-fd3ba73d-5570-46dd-817e-d7786320ae57 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 109c8a70-7b89-45b4-8876-a3286375b27d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:42:32.204277 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-fd3ba73d-5570-46dd-817e-d7786320ae57 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:32.204759 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-fd3ba73d-5570-46dd-817e-d7786320ae57 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:32.205516 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-fd3ba73d-5570-46dd-817e-d7786320ae57 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:32.205954 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-fd3ba73d-5570-46dd-817e-d7786320ae57 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:32.342360 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-fd3ba73d-5570-46dd-817e-d7786320ae57 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:42:32.350829 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-fd3ba73d-5570-46dd-817e-d7786320ae57 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d" status: 200 len: 1519 microversion: 2.1 time: 0.157745 Jun 30 10:42:32.351402 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 226/457] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:42:32 2022] GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:42:33.368236 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-92ce3fc4-0511-4a34-a09a-c8a5f0ed6b03 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:42:33.368926 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-92ce3fc4-0511-4a34-a09a-c8a5f0ed6b03 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 109c8a70-7b89-45b4-8876-a3286375b27d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:42:33.375165 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-92ce3fc4-0511-4a34-a09a-c8a5f0ed6b03 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:33.375609 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-92ce3fc4-0511-4a34-a09a-c8a5f0ed6b03 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:33.376367 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-92ce3fc4-0511-4a34-a09a-c8a5f0ed6b03 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:33.376831 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-92ce3fc4-0511-4a34-a09a-c8a5f0ed6b03 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:33.501598 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-92ce3fc4-0511-4a34-a09a-c8a5f0ed6b03 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:42:33.509390 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-92ce3fc4-0511-4a34-a09a-c8a5f0ed6b03 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d" status: 200 len: 1519 microversion: 2.1 time: 0.144959 Jun 30 10:42:33.509970 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 232/458] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:42:33 2022] GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d => generated 1519 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:42:34.526089 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-3d176bae-c794-494b-8b96-10c3f5d010ae tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:42:34.526881 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-3d176bae-c794-494b-8b96-10c3f5d010ae tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 109c8a70-7b89-45b4-8876-a3286375b27d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:42:34.529201 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_api:SELECT=43 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:42:34.535284 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-3d176bae-c794-494b-8b96-10c3f5d010ae tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:34.535732 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-3d176bae-c794-494b-8b96-10c3f5d010ae tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:34.536494 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-3d176bae-c794-494b-8b96-10c3f5d010ae tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:34.536997 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-3d176bae-c794-494b-8b96-10c3f5d010ae tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:34.670178 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-3d176bae-c794-494b-8b96-10c3f5d010ae tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:42:34.677785 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-3d176bae-c794-494b-8b96-10c3f5d010ae tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d" status: 200 len: 1519 microversion: 2.1 time: 0.155473 Jun 30 10:42:34.678590 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 227/459] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:42:34 2022] GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:42:35.695375 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-9fb4b419-fd10-44bb-bf84-925d4c90eb05 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:42:35.695904 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-9fb4b419-fd10-44bb-bf84-925d4c90eb05 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 109c8a70-7b89-45b4-8876-a3286375b27d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:42:35.702117 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-9fb4b419-fd10-44bb-bf84-925d4c90eb05 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:35.702561 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-9fb4b419-fd10-44bb-bf84-925d4c90eb05 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:35.703323 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-9fb4b419-fd10-44bb-bf84-925d4c90eb05 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:35.703761 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-9fb4b419-fd10-44bb-bf84-925d4c90eb05 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:35.834644 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-9fb4b419-fd10-44bb-bf84-925d4c90eb05 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:42:35.842420 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-9fb4b419-fd10-44bb-bf84-925d4c90eb05 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d" status: 200 len: 1519 microversion: 2.1 time: 0.150912 Jun 30 10:42:35.843003 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 233/460] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:42:35 2022] GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:42:36.859282 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-7bf906bf-0793-44e0-b60f-a2b649990b7c tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:42:36.859988 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-7bf906bf-0793-44e0-b60f-a2b649990b7c tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 109c8a70-7b89-45b4-8876-a3286375b27d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:42:36.866644 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-7bf906bf-0793-44e0-b60f-a2b649990b7c tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:36.867089 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-7bf906bf-0793-44e0-b60f-a2b649990b7c tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:36.867841 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-7bf906bf-0793-44e0-b60f-a2b649990b7c tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:36.868272 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-7bf906bf-0793-44e0-b60f-a2b649990b7c tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:37.006183 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-7bf906bf-0793-44e0-b60f-a2b649990b7c tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:42:37.013636 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-7bf906bf-0793-44e0-b60f-a2b649990b7c tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d" status: 200 len: 1519 microversion: 2.1 time: 0.158352 Jun 30 10:42:37.014216 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 228/461] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:42:36 2022] GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:42:38.030532 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-37ed63bc-4411-4f44-a933-fe407d62e403 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:42:38.031139 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-37ed63bc-4411-4f44-a933-fe407d62e403 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 109c8a70-7b89-45b4-8876-a3286375b27d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:42:38.037320 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-37ed63bc-4411-4f44-a933-fe407d62e403 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:38.037773 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-37ed63bc-4411-4f44-a933-fe407d62e403 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:38.038535 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-37ed63bc-4411-4f44-a933-fe407d62e403 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:38.038978 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-37ed63bc-4411-4f44-a933-fe407d62e403 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:38.173103 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-37ed63bc-4411-4f44-a933-fe407d62e403 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:42:38.180994 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-37ed63bc-4411-4f44-a933-fe407d62e403 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d" status: 200 len: 1519 microversion: 2.1 time: 0.154433 Jun 30 10:42:38.181568 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 234/462] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:42:38 2022] GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:42:39.197917 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-f9c67431-74e8-42fd-85eb-ba93d9c9d3fc tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:42:39.198596 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-f9c67431-74e8-42fd-85eb-ba93d9c9d3fc tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 109c8a70-7b89-45b4-8876-a3286375b27d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:42:39.205402 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f9c67431-74e8-42fd-85eb-ba93d9c9d3fc tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:39.206065 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f9c67431-74e8-42fd-85eb-ba93d9c9d3fc tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:39.206995 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f9c67431-74e8-42fd-85eb-ba93d9c9d3fc tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:39.207432 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f9c67431-74e8-42fd-85eb-ba93d9c9d3fc tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:39.359480 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-f9c67431-74e8-42fd-85eb-ba93d9c9d3fc tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:42:39.367961 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-f9c67431-74e8-42fd-85eb-ba93d9c9d3fc tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d" status: 200 len: 1519 microversion: 2.1 time: 0.173968 Jun 30 10:42:39.368643 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 229/463] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:42:39 2022] GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d => generated 1519 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:42:40.388614 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-cc9eddaa-f10c-4021-a9ff-9bea05ef0f81 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:42:40.389252 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-cc9eddaa-f10c-4021-a9ff-9bea05ef0f81 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 109c8a70-7b89-45b4-8876-a3286375b27d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:42:40.394413 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:42:40.396814 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-cc9eddaa-f10c-4021-a9ff-9bea05ef0f81 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:40.397703 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-cc9eddaa-f10c-4021-a9ff-9bea05ef0f81 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:40.398625 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-cc9eddaa-f10c-4021-a9ff-9bea05ef0f81 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:40.399211 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-cc9eddaa-f10c-4021-a9ff-9bea05ef0f81 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:40.565246 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-cc9eddaa-f10c-4021-a9ff-9bea05ef0f81 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:42:40.574093 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-cc9eddaa-f10c-4021-a9ff-9bea05ef0f81 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d" status: 200 len: 1519 microversion: 2.1 time: 0.190984 Jun 30 10:42:40.575066 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 235/464] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:42:40 2022] GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d => generated 1519 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:42:41.591160 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-c7fc2110-7c93-4ecd-a86c-05767f591f29 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:42:41.591915 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-c7fc2110-7c93-4ecd-a86c-05767f591f29 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 109c8a70-7b89-45b4-8876-a3286375b27d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:42:41.599205 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c7fc2110-7c93-4ecd-a86c-05767f591f29 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:41.599883 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c7fc2110-7c93-4ecd-a86c-05767f591f29 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:41.600748 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c7fc2110-7c93-4ecd-a86c-05767f591f29 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:41.601237 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c7fc2110-7c93-4ecd-a86c-05767f591f29 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:41.752751 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-c7fc2110-7c93-4ecd-a86c-05767f591f29 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:42:41.763126 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-c7fc2110-7c93-4ecd-a86c-05767f591f29 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d" status: 200 len: 1519 microversion: 2.1 time: 0.175813 Jun 30 10:42:41.764828 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 230/465] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:42:41 2022] GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d => generated 1519 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:42:42.780714 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-8fa5b614-7157-4bd2-bf86-754f7ae10cb1 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:42:42.781942 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-8fa5b614-7157-4bd2-bf86-754f7ae10cb1 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 109c8a70-7b89-45b4-8876-a3286375b27d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:42:42.788854 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-8fa5b614-7157-4bd2-bf86-754f7ae10cb1 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:42.789300 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-8fa5b614-7157-4bd2-bf86-754f7ae10cb1 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:42.790091 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-8fa5b614-7157-4bd2-bf86-754f7ae10cb1 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:42.790525 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-8fa5b614-7157-4bd2-bf86-754f7ae10cb1 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:42.919994 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-8fa5b614-7157-4bd2-bf86-754f7ae10cb1 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:42:42.927563 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-8fa5b614-7157-4bd2-bf86-754f7ae10cb1 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d" status: 200 len: 1519 microversion: 2.1 time: 0.150797 Jun 30 10:42:42.928120 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 236/466] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:42:42 2022] GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:42:43.222306 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-01ca72cf-d390-418e-aa4e-844f7c6e819a tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "75e747a7-2959-4a62-a0ca-f16b6de21163", "device": "/dev/sdb"}} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:42:43.223872 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-01ca72cf-d390-418e-aa4e-844f7c6e819a tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] [instance: 6385416e-65e3-4edd-b542-1b8b44cde2e2] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:42:43.230371 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-01ca72cf-d390-418e-aa4e-844f7c6e819a tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:43.231101 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-01ca72cf-d390-418e-aa4e-844f7c6e819a tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:43.231850 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-01ca72cf-d390-418e-aa4e-844f7c6e819a tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:43.232288 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-01ca72cf-d390-418e-aa4e-844f7c6e819a tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:43.524269 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-01ca72cf-d390-418e-aa4e-844f7c6e819a tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] 10.222.0.59 "POST /compute/v2.1/servers/6385416e-65e3-4edd-b542-1b8b44cde2e2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.305689 Jun 30 10:42:43.525360 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 231/467] 10.222.0.59 () {60 vars in 1322 bytes} [Thu Jun 30 10:42:43 2022] POST /compute/v2.1/servers/6385416e-65e3-4edd-b542-1b8b44cde2e2/os-volume_attachments => generated 194 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:42:43.945815 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-936669c2-6ddd-4ae2-9f69-962b7fb202f0 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:42:43.946370 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-936669c2-6ddd-4ae2-9f69-962b7fb202f0 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 109c8a70-7b89-45b4-8876-a3286375b27d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:42:43.953319 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-936669c2-6ddd-4ae2-9f69-962b7fb202f0 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:43.953782 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-936669c2-6ddd-4ae2-9f69-962b7fb202f0 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:43.954621 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-936669c2-6ddd-4ae2-9f69-962b7fb202f0 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:43.955089 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-936669c2-6ddd-4ae2-9f69-962b7fb202f0 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:43.976458 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:42:44.100732 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-936669c2-6ddd-4ae2-9f69-962b7fb202f0 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:42:44.108820 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-936669c2-6ddd-4ae2-9f69-962b7fb202f0 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d" status: 200 len: 1519 microversion: 2.1 time: 0.167621 Jun 30 10:42:44.111551 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 237/468] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:42:43 2022] GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d => generated 1519 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:42:45.127705 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-21249e27-513e-4856-9d31-f6ec1e16ff2a tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:42:45.128352 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-21249e27-513e-4856-9d31-f6ec1e16ff2a tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 109c8a70-7b89-45b4-8876-a3286375b27d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:42:45.137075 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-21249e27-513e-4856-9d31-f6ec1e16ff2a tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:45.137976 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-21249e27-513e-4856-9d31-f6ec1e16ff2a tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:45.138966 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-21249e27-513e-4856-9d31-f6ec1e16ff2a tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:45.139758 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-21249e27-513e-4856-9d31-f6ec1e16ff2a tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:45.361964 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-21249e27-513e-4856-9d31-f6ec1e16ff2a tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:42:45.370226 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-21249e27-513e-4856-9d31-f6ec1e16ff2a tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d" status: 200 len: 1519 microversion: 2.1 time: 0.246703 Jun 30 10:42:45.379625 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 232/469] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:42:45 2022] GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d => generated 1519 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:42:46.387703 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-8a3a2659-1f33-4721-83b2-699538f9b694 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:42:46.389260 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-8a3a2659-1f33-4721-83b2-699538f9b694 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 109c8a70-7b89-45b4-8876-a3286375b27d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:42:46.396913 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-8a3a2659-1f33-4721-83b2-699538f9b694 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:46.397835 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-8a3a2659-1f33-4721-83b2-699538f9b694 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:46.398903 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-8a3a2659-1f33-4721-83b2-699538f9b694 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:46.399543 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-8a3a2659-1f33-4721-83b2-699538f9b694 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:46.567145 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-8a3a2659-1f33-4721-83b2-699538f9b694 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:42:46.578671 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-8a3a2659-1f33-4721-83b2-699538f9b694 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d" status: 200 len: 1519 microversion: 2.1 time: 0.195045 Jun 30 10:42:46.614021 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 238/470] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:42:46 2022] GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d => generated 1519 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:42:47.597065 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-c21ba490-0a21-4b7c-bebe-dc4e25ae4003 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:42:47.597781 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-c21ba490-0a21-4b7c-bebe-dc4e25ae4003 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 109c8a70-7b89-45b4-8876-a3286375b27d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:42:47.607508 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c21ba490-0a21-4b7c-bebe-dc4e25ae4003 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:47.607960 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c21ba490-0a21-4b7c-bebe-dc4e25ae4003 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:47.608981 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c21ba490-0a21-4b7c-bebe-dc4e25ae4003 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:47.609423 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c21ba490-0a21-4b7c-bebe-dc4e25ae4003 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:47.764683 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-c21ba490-0a21-4b7c-bebe-dc4e25ae4003 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:42:47.774338 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-c21ba490-0a21-4b7c-bebe-dc4e25ae4003 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d" status: 200 len: 1519 microversion: 2.1 time: 0.181814 Jun 30 10:42:47.774926 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 233/471] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:42:47 2022] GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d => generated 1519 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:42:48.791051 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-ca29cf7b-c33e-450f-91b6-a9187ca17ccc tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:42:48.792462 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-ca29cf7b-c33e-450f-91b6-a9187ca17ccc tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 109c8a70-7b89-45b4-8876-a3286375b27d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:42:48.798597 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ca29cf7b-c33e-450f-91b6-a9187ca17ccc tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:48.799042 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ca29cf7b-c33e-450f-91b6-a9187ca17ccc tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:48.799992 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ca29cf7b-c33e-450f-91b6-a9187ca17ccc tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:48.800664 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ca29cf7b-c33e-450f-91b6-a9187ca17ccc tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:48.994549 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-ca29cf7b-c33e-450f-91b6-a9187ca17ccc tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:42:49.006416 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-ca29cf7b-c33e-450f-91b6-a9187ca17ccc tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d" status: 200 len: 1519 microversion: 2.1 time: 0.218966 Jun 30 10:42:49.014138 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 239/472] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:42:48 2022] GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d => generated 1519 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:42:50.027202 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-e961c0c3-4219-45a8-93f2-ad860d1a927c tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:42:50.027202 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-e961c0c3-4219-45a8-93f2-ad860d1a927c tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 109c8a70-7b89-45b4-8876-a3286375b27d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:42:50.030665 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-e961c0c3-4219-45a8-93f2-ad860d1a927c tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:50.031071 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-e961c0c3-4219-45a8-93f2-ad860d1a927c tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:50.034194 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-e961c0c3-4219-45a8-93f2-ad860d1a927c tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:50.034860 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-e961c0c3-4219-45a8-93f2-ad860d1a927c tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:50.167510 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-e961c0c3-4219-45a8-93f2-ad860d1a927c tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:42:50.174911 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-e961c0c3-4219-45a8-93f2-ad860d1a927c tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d" status: 200 len: 1519 microversion: 2.1 time: 0.155558 Jun 30 10:42:50.175472 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 234/473] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:42:50 2022] GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:42:51.191329 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-c938a1fe-27a0-4832-9aa9-62706d3316ad tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:42:51.191938 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-c938a1fe-27a0-4832-9aa9-62706d3316ad tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 109c8a70-7b89-45b4-8876-a3286375b27d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:42:51.198487 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c938a1fe-27a0-4832-9aa9-62706d3316ad tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:51.198937 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c938a1fe-27a0-4832-9aa9-62706d3316ad tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:51.199699 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c938a1fe-27a0-4832-9aa9-62706d3316ad tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:51.200148 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c938a1fe-27a0-4832-9aa9-62706d3316ad tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:51.326057 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-c938a1fe-27a0-4832-9aa9-62706d3316ad tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:42:51.334032 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-c938a1fe-27a0-4832-9aa9-62706d3316ad tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d" status: 200 len: 1519 microversion: 2.1 time: 0.145952 Jun 30 10:42:51.334595 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 240/474] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:42:51 2022] GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d => generated 1519 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:42:52.351600 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-46b209a7-f621-4aa1-b5d4-34e6fca3f202 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:42:52.352205 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-46b209a7-f621-4aa1-b5d4-34e6fca3f202 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 109c8a70-7b89-45b4-8876-a3286375b27d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:42:52.359240 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-46b209a7-f621-4aa1-b5d4-34e6fca3f202 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:52.359688 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-46b209a7-f621-4aa1-b5d4-34e6fca3f202 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:52.360454 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-46b209a7-f621-4aa1-b5d4-34e6fca3f202 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:52.360932 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-46b209a7-f621-4aa1-b5d4-34e6fca3f202 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:52.489962 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-46b209a7-f621-4aa1-b5d4-34e6fca3f202 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:42:52.497355 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-46b209a7-f621-4aa1-b5d4-34e6fca3f202 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d" status: 200 len: 1519 microversion: 2.1 time: 0.150289 Jun 30 10:42:52.497925 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 235/475] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:42:52 2022] GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:42:53.514573 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-0c454528-86da-47be-9322-fd97ad597292 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:42:53.515174 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-0c454528-86da-47be-9322-fd97ad597292 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 109c8a70-7b89-45b4-8876-a3286375b27d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:42:53.521266 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0c454528-86da-47be-9322-fd97ad597292 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:53.521652 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0c454528-86da-47be-9322-fd97ad597292 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:53.522401 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0c454528-86da-47be-9322-fd97ad597292 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:53.522827 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0c454528-86da-47be-9322-fd97ad597292 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:53.679789 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-0c454528-86da-47be-9322-fd97ad597292 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:42:53.692420 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-0c454528-86da-47be-9322-fd97ad597292 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d" status: 200 len: 1519 microversion: 2.1 time: 0.182352 Jun 30 10:42:53.706561 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 241/476] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:42:53 2022] GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d => generated 1519 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:42:54.722264 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-f4d9b36a-a736-4790-ab03-802e8a0641ea tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:42:54.723089 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-f4d9b36a-a736-4790-ab03-802e8a0641ea tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 109c8a70-7b89-45b4-8876-a3286375b27d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:42:54.733553 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f4d9b36a-a736-4790-ab03-802e8a0641ea tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:54.734222 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f4d9b36a-a736-4790-ab03-802e8a0641ea tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:54.735478 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f4d9b36a-a736-4790-ab03-802e8a0641ea tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:54.736164 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f4d9b36a-a736-4790-ab03-802e8a0641ea tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:54.890981 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-f4d9b36a-a736-4790-ab03-802e8a0641ea tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:42:54.902922 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-f4d9b36a-a736-4790-ab03-802e8a0641ea tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d" status: 200 len: 1519 microversion: 2.1 time: 0.188317 Jun 30 10:42:54.903499 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 236/477] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:42:54 2022] GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d => generated 1519 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:42:55.920190 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-cdc2405d-8b85-4f6b-bc64-0d4889474911 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:42:55.921030 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-cdc2405d-8b85-4f6b-bc64-0d4889474911 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 109c8a70-7b89-45b4-8876-a3286375b27d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:42:55.928604 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-cdc2405d-8b85-4f6b-bc64-0d4889474911 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:55.929053 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-cdc2405d-8b85-4f6b-bc64-0d4889474911 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:55.929809 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-cdc2405d-8b85-4f6b-bc64-0d4889474911 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:55.930406 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-cdc2405d-8b85-4f6b-bc64-0d4889474911 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:56.065619 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-cdc2405d-8b85-4f6b-bc64-0d4889474911 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:42:56.074269 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-cdc2405d-8b85-4f6b-bc64-0d4889474911 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d" status: 200 len: 1519 microversion: 2.1 time: 0.157875 Jun 30 10:42:56.075170 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 242/478] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:42:55 2022] GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:42:57.093286 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-ce692481-8ec6-4205-99ae-9f6ec06c7a48 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:42:57.094878 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-ce692481-8ec6-4205-99ae-9f6ec06c7a48 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 109c8a70-7b89-45b4-8876-a3286375b27d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:42:57.103439 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ce692481-8ec6-4205-99ae-9f6ec06c7a48 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:57.103964 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ce692481-8ec6-4205-99ae-9f6ec06c7a48 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:57.104918 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ce692481-8ec6-4205-99ae-9f6ec06c7a48 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:57.105387 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ce692481-8ec6-4205-99ae-9f6ec06c7a48 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:57.265253 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-ce692481-8ec6-4205-99ae-9f6ec06c7a48 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:42:57.279109 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-ce692481-8ec6-4205-99ae-9f6ec06c7a48 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d" status: 200 len: 1519 microversion: 2.1 time: 0.189795 Jun 30 10:42:57.279866 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 237/479] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:42:57 2022] GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d => generated 1519 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:42:58.297232 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-8de33c4e-4a07-4abd-8896-5982387a66d0 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:42:58.298171 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-8de33c4e-4a07-4abd-8896-5982387a66d0 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 109c8a70-7b89-45b4-8876-a3286375b27d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:42:58.304849 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-8de33c4e-4a07-4abd-8896-5982387a66d0 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:58.305510 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-8de33c4e-4a07-4abd-8896-5982387a66d0 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:58.306458 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-8de33c4e-4a07-4abd-8896-5982387a66d0 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:58.307062 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-8de33c4e-4a07-4abd-8896-5982387a66d0 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:58.442873 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-8de33c4e-4a07-4abd-8896-5982387a66d0 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:42:58.450814 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-8de33c4e-4a07-4abd-8896-5982387a66d0 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d" status: 200 len: 1519 microversion: 2.1 time: 0.157666 Jun 30 10:42:58.461412 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 243/480] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:42:58 2022] GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:42:59.469030 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-68fbef20-e3c2-43ea-9423-67774076807a tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:42:59.470395 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-68fbef20-e3c2-43ea-9423-67774076807a tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 109c8a70-7b89-45b4-8876-a3286375b27d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:42:59.477780 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-68fbef20-e3c2-43ea-9423-67774076807a tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:59.478694 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-68fbef20-e3c2-43ea-9423-67774076807a tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:59.480229 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-68fbef20-e3c2-43ea-9423-67774076807a tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:42:59.481864 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-68fbef20-e3c2-43ea-9423-67774076807a tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:42:59.498763 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:42:59.689960 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-68fbef20-e3c2-43ea-9423-67774076807a tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:42:59.698791 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-68fbef20-e3c2-43ea-9423-67774076807a tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d" status: 200 len: 1519 microversion: 2.1 time: 0.233609 Jun 30 10:42:59.699879 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 238/481] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:42:59 2022] GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d => generated 1519 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:43:00.722962 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-e9fd0727-6bd3-4f85-9812-09329600ba49 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:43:00.723707 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-e9fd0727-6bd3-4f85-9812-09329600ba49 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 109c8a70-7b89-45b4-8876-a3286375b27d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:43:00.730361 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e9fd0727-6bd3-4f85-9812-09329600ba49 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:00.731164 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e9fd0727-6bd3-4f85-9812-09329600ba49 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:00.732007 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e9fd0727-6bd3-4f85-9812-09329600ba49 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:00.732454 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e9fd0727-6bd3-4f85-9812-09329600ba49 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:00.874014 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-e9fd0727-6bd3-4f85-9812-09329600ba49 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:43:00.882482 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-e9fd0727-6bd3-4f85-9812-09329600ba49 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d" status: 200 len: 1519 microversion: 2.1 time: 0.163342 Jun 30 10:43:00.883079 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 244/482] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:43:00 2022] GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d => generated 1519 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:43:01.900005 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-65315bcf-6cef-462a-9bf2-f4b7c9a39e19 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:43:01.900690 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-65315bcf-6cef-462a-9bf2-f4b7c9a39e19 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 109c8a70-7b89-45b4-8876-a3286375b27d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:43:01.907079 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-65315bcf-6cef-462a-9bf2-f4b7c9a39e19 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:01.907520 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-65315bcf-6cef-462a-9bf2-f4b7c9a39e19 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:01.908271 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-65315bcf-6cef-462a-9bf2-f4b7c9a39e19 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:01.908739 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-65315bcf-6cef-462a-9bf2-f4b7c9a39e19 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:02.036885 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-65315bcf-6cef-462a-9bf2-f4b7c9a39e19 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:43:02.044369 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-65315bcf-6cef-462a-9bf2-f4b7c9a39e19 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d" status: 200 len: 1519 microversion: 2.1 time: 0.148823 Jun 30 10:43:02.044981 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 239/483] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:43:01 2022] GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d => generated 1519 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:43:03.062096 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-34f8368e-8142-4984-883e-bc9c4b3801d7 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:43:03.062700 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-34f8368e-8142-4984-883e-bc9c4b3801d7 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 109c8a70-7b89-45b4-8876-a3286375b27d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:43:03.068742 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-34f8368e-8142-4984-883e-bc9c4b3801d7 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:03.069188 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-34f8368e-8142-4984-883e-bc9c4b3801d7 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:03.070087 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-34f8368e-8142-4984-883e-bc9c4b3801d7 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:03.070533 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-34f8368e-8142-4984-883e-bc9c4b3801d7 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:03.203245 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-34f8368e-8142-4984-883e-bc9c4b3801d7 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:43:03.211381 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-34f8368e-8142-4984-883e-bc9c4b3801d7 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d" status: 200 len: 1519 microversion: 2.1 time: 0.153241 Jun 30 10:43:03.211936 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 245/484] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:43:03 2022] GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:43:04.227449 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-dfaf4be1-301e-449e-b747-64f30e9cb101 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:43:04.228061 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-dfaf4be1-301e-449e-b747-64f30e9cb101 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 109c8a70-7b89-45b4-8876-a3286375b27d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:43:04.234819 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-dfaf4be1-301e-449e-b747-64f30e9cb101 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:04.235269 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-dfaf4be1-301e-449e-b747-64f30e9cb101 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:04.236033 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-dfaf4be1-301e-449e-b747-64f30e9cb101 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:04.236470 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-dfaf4be1-301e-449e-b747-64f30e9cb101 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:04.362350 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-dfaf4be1-301e-449e-b747-64f30e9cb101 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:43:04.369741 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-dfaf4be1-301e-449e-b747-64f30e9cb101 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d" status: 200 len: 1519 microversion: 2.1 time: 0.146681 Jun 30 10:43:04.370297 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 240/485] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:43:04 2022] GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d => generated 1519 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:43:05.386721 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-b838d19f-94e0-4970-8bb1-3ccf08d9b100 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:43:05.387333 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-b838d19f-94e0-4970-8bb1-3ccf08d9b100 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 109c8a70-7b89-45b4-8876-a3286375b27d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:43:05.393528 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b838d19f-94e0-4970-8bb1-3ccf08d9b100 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:05.393982 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b838d19f-94e0-4970-8bb1-3ccf08d9b100 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:05.394752 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b838d19f-94e0-4970-8bb1-3ccf08d9b100 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:05.395188 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b838d19f-94e0-4970-8bb1-3ccf08d9b100 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:05.522965 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-b838d19f-94e0-4970-8bb1-3ccf08d9b100 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:43:05.530333 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-b838d19f-94e0-4970-8bb1-3ccf08d9b100 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d" status: 200 len: 1519 microversion: 2.1 time: 0.147414 Jun 30 10:43:05.530903 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 246/486] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:43:05 2022] GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d => generated 1519 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:43:06.547027 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-797014e1-d3b7-4c82-af5b-33d11d02f708 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:43:06.547633 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-797014e1-d3b7-4c82-af5b-33d11d02f708 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 109c8a70-7b89-45b4-8876-a3286375b27d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:43:06.549997 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_api:SELECT=28 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:43:06.555730 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-797014e1-d3b7-4c82-af5b-33d11d02f708 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:06.556168 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-797014e1-d3b7-4c82-af5b-33d11d02f708 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:06.556944 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-797014e1-d3b7-4c82-af5b-33d11d02f708 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:06.557374 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-797014e1-d3b7-4c82-af5b-33d11d02f708 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:06.693793 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-797014e1-d3b7-4c82-af5b-33d11d02f708 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:43:06.701283 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-797014e1-d3b7-4c82-af5b-33d11d02f708 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d" status: 200 len: 1519 microversion: 2.1 time: 0.158163 Jun 30 10:43:06.701847 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 241/487] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:43:06 2022] GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:43:07.717988 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-bfae5c13-a0db-4476-8d59-b351c53a308d tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:43:07.718596 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-bfae5c13-a0db-4476-8d59-b351c53a308d tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 109c8a70-7b89-45b4-8876-a3286375b27d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:43:07.724601 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-bfae5c13-a0db-4476-8d59-b351c53a308d tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:07.725046 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-bfae5c13-a0db-4476-8d59-b351c53a308d tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:07.725829 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-bfae5c13-a0db-4476-8d59-b351c53a308d tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:07.726265 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-bfae5c13-a0db-4476-8d59-b351c53a308d tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:07.851153 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-bfae5c13-a0db-4476-8d59-b351c53a308d tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:43:07.858752 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-bfae5c13-a0db-4476-8d59-b351c53a308d tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d" status: 200 len: 1519 microversion: 2.1 time: 0.144664 Jun 30 10:43:07.859315 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 247/488] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:43:07 2022] GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d => generated 1519 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:43:08.876016 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-53b746f4-8213-4a05-ac86-3db5f1515fbb tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:43:08.876689 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-53b746f4-8213-4a05-ac86-3db5f1515fbb tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 109c8a70-7b89-45b4-8876-a3286375b27d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:43:08.883193 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-53b746f4-8213-4a05-ac86-3db5f1515fbb tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:08.883644 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-53b746f4-8213-4a05-ac86-3db5f1515fbb tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:08.884408 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-53b746f4-8213-4a05-ac86-3db5f1515fbb tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:08.884891 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-53b746f4-8213-4a05-ac86-3db5f1515fbb tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:09.012779 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-53b746f4-8213-4a05-ac86-3db5f1515fbb tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:43:09.020175 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-53b746f4-8213-4a05-ac86-3db5f1515fbb tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d" status: 200 len: 1519 microversion: 2.1 time: 0.148048 Jun 30 10:43:09.021259 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 242/489] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:43:08 2022] GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d => generated 1519 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:43:10.037864 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-8994fd9c-3c5a-4603-9d6f-d9295e7759b3 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:43:10.038470 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-8994fd9c-3c5a-4603-9d6f-d9295e7759b3 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 109c8a70-7b89-45b4-8876-a3286375b27d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:43:10.044550 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-8994fd9c-3c5a-4603-9d6f-d9295e7759b3 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:10.045006 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-8994fd9c-3c5a-4603-9d6f-d9295e7759b3 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:10.045764 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-8994fd9c-3c5a-4603-9d6f-d9295e7759b3 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:10.046202 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-8994fd9c-3c5a-4603-9d6f-d9295e7759b3 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:10.173462 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-8994fd9c-3c5a-4603-9d6f-d9295e7759b3 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:43:10.181508 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-8994fd9c-3c5a-4603-9d6f-d9295e7759b3 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d" status: 200 len: 1519 microversion: 2.1 time: 0.147969 Jun 30 10:43:10.182012 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 248/490] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:43:10 2022] GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d => generated 1519 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:43:11.198629 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-2570e930-f80a-4dd5-8472-3eb52940b815 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:43:11.199232 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-2570e930-f80a-4dd5-8472-3eb52940b815 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 109c8a70-7b89-45b4-8876-a3286375b27d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:43:11.205813 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-2570e930-f80a-4dd5-8472-3eb52940b815 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:11.206145 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-2570e930-f80a-4dd5-8472-3eb52940b815 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:11.206903 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-2570e930-f80a-4dd5-8472-3eb52940b815 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:11.207332 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-2570e930-f80a-4dd5-8472-3eb52940b815 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:11.344020 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-2570e930-f80a-4dd5-8472-3eb52940b815 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:43:11.352662 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-2570e930-f80a-4dd5-8472-3eb52940b815 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d" status: 200 len: 1519 microversion: 2.1 time: 0.157795 Jun 30 10:43:11.353541 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 243/491] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:43:11 2022] GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:43:12.370664 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-8bb29f60-39f5-4cc0-bbed-363a82e29dd3 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:43:12.371277 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-8bb29f60-39f5-4cc0-bbed-363a82e29dd3 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 109c8a70-7b89-45b4-8876-a3286375b27d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:43:12.373156 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_api:SELECT=28 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:43:12.378771 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-8bb29f60-39f5-4cc0-bbed-363a82e29dd3 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:12.379221 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-8bb29f60-39f5-4cc0-bbed-363a82e29dd3 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:12.379981 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-8bb29f60-39f5-4cc0-bbed-363a82e29dd3 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:12.380416 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-8bb29f60-39f5-4cc0-bbed-363a82e29dd3 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:12.506900 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-8bb29f60-39f5-4cc0-bbed-363a82e29dd3 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:43:12.514447 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-8bb29f60-39f5-4cc0-bbed-363a82e29dd3 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d" status: 200 len: 1519 microversion: 2.1 time: 0.147654 Jun 30 10:43:12.514953 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 249/492] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:43:12 2022] GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d => generated 1519 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:43:13.530802 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-702edd8d-37de-40e9-92b1-614f984227e3 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:43:13.531348 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-702edd8d-37de-40e9-92b1-614f984227e3 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 109c8a70-7b89-45b4-8876-a3286375b27d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:43:13.537885 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-702edd8d-37de-40e9-92b1-614f984227e3 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:13.538334 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-702edd8d-37de-40e9-92b1-614f984227e3 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:13.539098 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-702edd8d-37de-40e9-92b1-614f984227e3 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:13.539537 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-702edd8d-37de-40e9-92b1-614f984227e3 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:13.667470 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-702edd8d-37de-40e9-92b1-614f984227e3 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:43:13.674961 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-702edd8d-37de-40e9-92b1-614f984227e3 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d" status: 200 len: 1519 microversion: 2.1 time: 0.147994 Jun 30 10:43:13.675528 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 244/493] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:43:13 2022] GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d => generated 1519 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:43:14.692110 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-de02ec69-4823-4f49-a19c-3b026a3db352 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:43:14.692785 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-de02ec69-4823-4f49-a19c-3b026a3db352 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 109c8a70-7b89-45b4-8876-a3286375b27d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:43:14.699167 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-de02ec69-4823-4f49-a19c-3b026a3db352 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:14.699662 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-de02ec69-4823-4f49-a19c-3b026a3db352 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:14.700366 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-de02ec69-4823-4f49-a19c-3b026a3db352 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:14.700824 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-de02ec69-4823-4f49-a19c-3b026a3db352 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:14.703586 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_cell1:SELECT=75 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:43:14.832650 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-de02ec69-4823-4f49-a19c-3b026a3db352 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:43:14.840605 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-de02ec69-4823-4f49-a19c-3b026a3db352 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d" status: 200 len: 1519 microversion: 2.1 time: 0.152292 Jun 30 10:43:14.841169 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 250/494] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:43:14 2022] GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:43:15.857717 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-7acaf207-edb2-46ed-a392-d648278091ff tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:43:15.858322 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-7acaf207-edb2-46ed-a392-d648278091ff tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 109c8a70-7b89-45b4-8876-a3286375b27d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:43:15.865594 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-7acaf207-edb2-46ed-a392-d648278091ff tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:15.866045 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-7acaf207-edb2-46ed-a392-d648278091ff tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:15.866812 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-7acaf207-edb2-46ed-a392-d648278091ff tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:15.867257 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-7acaf207-edb2-46ed-a392-d648278091ff tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:15.992423 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-7acaf207-edb2-46ed-a392-d648278091ff tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:43:15.999928 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-7acaf207-edb2-46ed-a392-d648278091ff tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d" status: 200 len: 1499 microversion: 2.1 time: 0.146243 Jun 30 10:43:16.000465 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 245/495] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:43:15 2022] GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d => generated 1499 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:43:16.015937 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-cb511ba1-1474-43dd-8d86-8161aa0ec2df tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "754afa39-cac5-4adf-864b-740e84f0cad7"}} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:43:16.017082 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-cb511ba1-1474-43dd-8d86-8161aa0ec2df tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 109c8a70-7b89-45b4-8876-a3286375b27d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:43:16.023156 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-cb511ba1-1474-43dd-8d86-8161aa0ec2df tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:16.023598 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-cb511ba1-1474-43dd-8d86-8161aa0ec2df tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:16.024369 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-cb511ba1-1474-43dd-8d86-8161aa0ec2df tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:16.024809 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-cb511ba1-1474-43dd-8d86-8161aa0ec2df tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:16.047380 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.wsgi [None req-cb511ba1-1474-43dd-8d86-8161aa0ec2df tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] HTTP exception thrown: Cannot 'attach_volume' instance 109c8a70-7b89-45b4-8876-a3286375b27d while it is in vm_state rescued Jun 30 10:43:16.049055 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-cb511ba1-1474-43dd-8d86-8161aa0ec2df tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Request method failure captured: Jun 30 10:43:16.049055 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: request: POST /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d/os-volume_attachments HTTP/1.1 Jun 30 10:43:16.049055 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Accept: application/json Jun 30 10:43:16.049055 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Accept-Encoding: identity Jun 30 10:43:16.049055 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Connection: close Jun 30 10:43:16.049055 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Content-Length: 74 Jun 30 10:43:16.049055 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Content-Type: application/json Jun 30 10:43:16.049055 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Host: 10.222.0.59 Jun 30 10:43:16.049055 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Openstack-System-Scope: None Jun 30 10:43:16.049055 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: User-Agent: python-urllib3/1.26.9 Jun 30 10:43:16.049055 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Auth-Token: gAAAAABivX2IaMKFb8aVjIO9EozePX71KBEfwyqcUMe3SvB2sa7oqzpACr1t048jevq1HnxAZYOcYQ9yz3sn3Mi-zB8W1WY1FWJvqYQmDU-ufetM9QN3XiPs0N0Ey6_49zVeCFmscnoJJ-2J3rZ2Q476IEMQO-fq6f0WYCxQpJ-MOJQFC-ZWmEU Jun 30 10:43:16.049055 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Domain-Id: None Jun 30 10:43:16.049055 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Domain-Name: None Jun 30 10:43:16.049055 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Identity-Status: Confirmed Jun 30 10:43:16.049055 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Is-Admin-Project: True Jun 30 10:43:16.049055 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Domain-Id: default Jun 30 10:43:16.049055 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Domain-Name: Default Jun 30 10:43:16.049055 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Id: 0e38b1cc4c0d45a8b38ba7b670f83c79 Jun 30 10:43:16.049055 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1656404926 Jun 30 10:43:16.049055 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Role: member,reader Jun 30 10:43:16.049055 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Roles: member,reader Jun 30 10:43:16.050622 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0e38b1cc4c0d45a8b38ba7b670f83c79"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0e38b1cc4c0d45a8b38ba7b670f83c79"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0e38b1cc4c0d45a8b38ba7b670f83c79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0e38b1cc4c0d45a8b38ba7b670f83c79"}]}] Jun 30 10:43:16.050622 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1656404926 Jun 30 10:43:16.050622 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant-Id: 0e38b1cc4c0d45a8b38ba7b670f83c79 Jun 30 10:43:16.050622 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1656404926 Jun 30 10:43:16.050622 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User: tempest-ServerRescueNegativeTestJSON-1656404926-project Jun 30 10:43:16.050622 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Domain-Id: default Jun 30 10:43:16.050622 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Domain-Name: Default Jun 30 10:43:16.050622 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Id: 6c963986b46d4d148fc843b0a1183d69 Jun 30 10:43:16.050622 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1656404926-project Jun 30 10:43:16.050622 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Jun 30 10:43:16.050622 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: {"volumeAttachment": {"volumeId": "754afa39-cac5-4adf-864b-740e84f0cad7"}} Jun 30 10:43:16.050622 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: method: > Jun 30 10:43:16.051492 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: exception: Cannot 'attach_volume' instance 109c8a70-7b89-45b4-8876-a3286375b27d while it is in vm_state rescued Jun 30 10:43:16.051492 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: action_args: {'server_id': '109c8a70-7b89-45b4-8876-a3286375b27d', 'body': {'volumeAttachment': {'volumeId': '754afa39-cac5-4adf-864b-740e84f0cad7'}}} Jun 30 10:43:16.051492 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:43:16.051492 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:43:16.051492 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 30 10:43:16.051492 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 30 10:43:16.051492 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 30 10:43:16.051492 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 30 10:43:16.051492 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 30 10:43:16.051492 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 30 10:43:16.051492 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 109c8a70-7b89-45b4-8876-a3286375b27d in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 30 10:43:16.051492 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:43:16.051492 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:43:16.051492 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:43:16.051492 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:43:16.051492 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:43:16.051492 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:43:16.051492 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:43:16.051492 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:43:16.053457 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:43:16.053457 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:43:16.053457 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 30 10:43:16.053457 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 10:43:16.053457 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 30 10:43:16.053457 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 10:43:16.053457 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 30 10:43:16.053457 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 10:43:16.053457 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 30 10:43:16.053457 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 30 10:43:16.053457 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 30 10:43:16.053457 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 30 10:43:16.053457 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 109c8a70-7b89-45b4-8876-a3286375b27d while it is in vm_state rescued Jun 30 10:43:16.053457 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:43:16.053457 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:43:16.053457 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:43:16.053457 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:43:16.053457 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:43:16.053457 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:43:16.054846 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:43:16.054846 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:43:16.054846 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 109c8a70-7b89-45b4-8876-a3286375b27d while it is in vm_state rescued Jun 30 10:43:16.054846 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:43:16.054846 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-cb511ba1-1474-43dd-8d86-8161aa0ec2df tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Returning 409 to user: Cannot 'attach_volume' instance 109c8a70-7b89-45b4-8876-a3286375b27d while it is in vm_state rescued {{(pid=124203) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:43:16.054846 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-cb511ba1-1474-43dd-8d86-8161aa0ec2df tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "POST /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.038518 Jun 30 10:43:16.054846 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 251/496] 10.222.0.59 () {60 vars in 1322 bytes} [Thu Jun 30 10:43:16 2022] POST /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d/os-volume_attachments => generated 152 bytes in 40 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 30 10:43:16.059860 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-b1596129-2751-488c-82e4-395abab888d9 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:43:16.060386 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-b1596129-2751-488c-82e4-395abab888d9 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 109c8a70-7b89-45b4-8876-a3286375b27d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:43:16.066421 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-b1596129-2751-488c-82e4-395abab888d9 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:16.066856 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-b1596129-2751-488c-82e4-395abab888d9 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:16.067599 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-b1596129-2751-488c-82e4-395abab888d9 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:16.068055 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-b1596129-2751-488c-82e4-395abab888d9 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:16.134967 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-b1596129-2751-488c-82e4-395abab888d9 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "POST /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d/action" status: 202 len: 0 microversion: 2.1 time: 0.078668 Jun 30 10:43:16.135599 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 246/497] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Jun 30 10:43:16 2022] POST /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 30 10:43:16.143668 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-f6921220-6e50-402f-bc99-ce8700328e0a tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:43:16.144274 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-f6921220-6e50-402f-bc99-ce8700328e0a tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 109c8a70-7b89-45b4-8876-a3286375b27d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:43:16.150297 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-f6921220-6e50-402f-bc99-ce8700328e0a tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:16.150739 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-f6921220-6e50-402f-bc99-ce8700328e0a tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:16.151498 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-f6921220-6e50-402f-bc99-ce8700328e0a tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:16.151931 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-f6921220-6e50-402f-bc99-ce8700328e0a tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:16.279870 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-f6921220-6e50-402f-bc99-ce8700328e0a tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:43:16.287482 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-f6921220-6e50-402f-bc99-ce8700328e0a tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d" status: 200 len: 1507 microversion: 2.1 time: 0.147614 Jun 30 10:43:16.288034 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 252/498] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:43:16 2022] GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d => generated 1507 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:43:17.305509 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-e79efd00-c4ba-4e58-90aa-7705d4769b4f tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:43:17.306197 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-e79efd00-c4ba-4e58-90aa-7705d4769b4f tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 109c8a70-7b89-45b4-8876-a3286375b27d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:43:17.312267 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-e79efd00-c4ba-4e58-90aa-7705d4769b4f tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:17.312745 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-e79efd00-c4ba-4e58-90aa-7705d4769b4f tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:17.313494 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-e79efd00-c4ba-4e58-90aa-7705d4769b4f tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:17.313917 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-e79efd00-c4ba-4e58-90aa-7705d4769b4f tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:17.438995 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-e79efd00-c4ba-4e58-90aa-7705d4769b4f tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:43:17.446886 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-e79efd00-c4ba-4e58-90aa-7705d4769b4f tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d" status: 200 len: 1507 microversion: 2.1 time: 0.146129 Jun 30 10:43:17.447449 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 247/499] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:43:17 2022] GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d => generated 1507 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:43:18.464498 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-c8a893a3-c75e-44f1-a3e1-41c37ef48027 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:43:18.465072 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-c8a893a3-c75e-44f1-a3e1-41c37ef48027 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 109c8a70-7b89-45b4-8876-a3286375b27d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:43:18.471125 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c8a893a3-c75e-44f1-a3e1-41c37ef48027 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:18.471575 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c8a893a3-c75e-44f1-a3e1-41c37ef48027 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:18.472343 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c8a893a3-c75e-44f1-a3e1-41c37ef48027 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:18.472836 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c8a893a3-c75e-44f1-a3e1-41c37ef48027 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:18.617858 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-c8a893a3-c75e-44f1-a3e1-41c37ef48027 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:43:18.625197 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-c8a893a3-c75e-44f1-a3e1-41c37ef48027 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d" status: 200 len: 1507 microversion: 2.1 time: 0.164718 Jun 30 10:43:18.625765 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 253/500] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:43:18 2022] GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d => generated 1507 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:43:19.642619 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-28040870-5701-4fc4-a2be-761cba354a67 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:43:19.643260 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-28040870-5701-4fc4-a2be-761cba354a67 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 109c8a70-7b89-45b4-8876-a3286375b27d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:43:19.649737 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-28040870-5701-4fc4-a2be-761cba354a67 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:19.650186 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-28040870-5701-4fc4-a2be-761cba354a67 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:19.650944 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-28040870-5701-4fc4-a2be-761cba354a67 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:19.651378 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-28040870-5701-4fc4-a2be-761cba354a67 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:19.790157 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-28040870-5701-4fc4-a2be-761cba354a67 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:43:19.798248 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-28040870-5701-4fc4-a2be-761cba354a67 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d" status: 200 len: 1507 microversion: 2.1 time: 0.159474 Jun 30 10:43:19.798982 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 248/501] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:43:19 2022] GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:43:20.814901 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-2846913b-2184-4067-93ff-ab213952aaf9 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:43:20.815507 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-2846913b-2184-4067-93ff-ab213952aaf9 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 109c8a70-7b89-45b4-8876-a3286375b27d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:43:20.821784 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-2846913b-2184-4067-93ff-ab213952aaf9 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:20.822231 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-2846913b-2184-4067-93ff-ab213952aaf9 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:20.822985 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-2846913b-2184-4067-93ff-ab213952aaf9 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:20.823418 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-2846913b-2184-4067-93ff-ab213952aaf9 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:20.951344 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-2846913b-2184-4067-93ff-ab213952aaf9 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:43:20.958683 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-2846913b-2184-4067-93ff-ab213952aaf9 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d" status: 200 len: 1507 microversion: 2.1 time: 0.147629 Jun 30 10:43:20.959809 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 254/502] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:43:20 2022] GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d => generated 1507 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:43:21.976645 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-ac6f05bc-ef39-48b2-b45b-114eb6f7f303 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:43:21.977252 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-ac6f05bc-ef39-48b2-b45b-114eb6f7f303 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 109c8a70-7b89-45b4-8876-a3286375b27d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:43:21.983716 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ac6f05bc-ef39-48b2-b45b-114eb6f7f303 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:21.984156 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ac6f05bc-ef39-48b2-b45b-114eb6f7f303 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:21.984931 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ac6f05bc-ef39-48b2-b45b-114eb6f7f303 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:21.985361 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ac6f05bc-ef39-48b2-b45b-114eb6f7f303 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:22.112988 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-ac6f05bc-ef39-48b2-b45b-114eb6f7f303 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:43:22.121059 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-ac6f05bc-ef39-48b2-b45b-114eb6f7f303 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d" status: 200 len: 1507 microversion: 2.1 time: 0.148880 Jun 30 10:43:22.121612 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 249/503] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:43:21 2022] GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d => generated 1507 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:43:23.137712 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-0401a7dc-501c-4b81-be0d-a79bc3c4c4b3 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:43:23.138486 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-0401a7dc-501c-4b81-be0d-a79bc3c4c4b3 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 109c8a70-7b89-45b4-8876-a3286375b27d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:43:23.144949 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0401a7dc-501c-4b81-be0d-a79bc3c4c4b3 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:23.145486 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0401a7dc-501c-4b81-be0d-a79bc3c4c4b3 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:23.146431 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0401a7dc-501c-4b81-be0d-a79bc3c4c4b3 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:23.151491 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0401a7dc-501c-4b81-be0d-a79bc3c4c4b3 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:23.281918 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-0401a7dc-501c-4b81-be0d-a79bc3c4c4b3 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:43:23.290082 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-0401a7dc-501c-4b81-be0d-a79bc3c4c4b3 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d" status: 200 len: 1507 microversion: 2.1 time: 0.156423 Jun 30 10:43:23.290653 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 255/504] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:43:23 2022] GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:43:24.307338 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-89f8d017-e79d-4d25-b729-b607f61ad530 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:43:24.307882 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-89f8d017-e79d-4d25-b729-b607f61ad530 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 109c8a70-7b89-45b4-8876-a3286375b27d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:43:24.314422 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-89f8d017-e79d-4d25-b729-b607f61ad530 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:24.314867 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-89f8d017-e79d-4d25-b729-b607f61ad530 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:24.315621 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-89f8d017-e79d-4d25-b729-b607f61ad530 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:24.316052 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-89f8d017-e79d-4d25-b729-b607f61ad530 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:24.440290 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-89f8d017-e79d-4d25-b729-b607f61ad530 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:43:24.447738 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-89f8d017-e79d-4d25-b729-b607f61ad530 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d" status: 200 len: 1507 microversion: 2.1 time: 0.144910 Jun 30 10:43:24.448307 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 250/505] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:43:24 2022] GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d => generated 1507 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:43:25.464394 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-836a65e1-d090-480b-8578-a2ce34b31c75 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:43:25.464983 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-836a65e1-d090-480b-8578-a2ce34b31c75 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 109c8a70-7b89-45b4-8876-a3286375b27d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:43:25.470926 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-836a65e1-d090-480b-8578-a2ce34b31c75 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:25.471364 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-836a65e1-d090-480b-8578-a2ce34b31c75 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:25.472137 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-836a65e1-d090-480b-8578-a2ce34b31c75 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:25.472595 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-836a65e1-d090-480b-8578-a2ce34b31c75 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:25.595743 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-836a65e1-d090-480b-8578-a2ce34b31c75 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:43:25.604578 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-836a65e1-d090-480b-8578-a2ce34b31c75 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d" status: 200 len: 1507 microversion: 2.1 time: 0.144035 Jun 30 10:43:25.605138 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 256/506] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:43:25 2022] GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d => generated 1507 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:43:26.621647 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-3bc2fc05-35fd-488e-8721-7d9c4e76d0b7 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:43:26.622261 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-3bc2fc05-35fd-488e-8721-7d9c4e76d0b7 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 109c8a70-7b89-45b4-8876-a3286375b27d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:43:26.629012 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-3bc2fc05-35fd-488e-8721-7d9c4e76d0b7 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:26.629463 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-3bc2fc05-35fd-488e-8721-7d9c4e76d0b7 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:26.630219 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-3bc2fc05-35fd-488e-8721-7d9c4e76d0b7 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:26.630654 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-3bc2fc05-35fd-488e-8721-7d9c4e76d0b7 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:26.760059 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-3bc2fc05-35fd-488e-8721-7d9c4e76d0b7 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:43:26.767553 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-3bc2fc05-35fd-488e-8721-7d9c4e76d0b7 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d" status: 200 len: 1507 microversion: 2.1 time: 0.149715 Jun 30 10:43:26.768118 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 251/507] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:43:26 2022] GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d => generated 1507 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:43:27.783916 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-a31f679d-ce45-459f-be61-11541cc91c24 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:43:27.784552 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-a31f679d-ce45-459f-be61-11541cc91c24 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 109c8a70-7b89-45b4-8876-a3286375b27d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:43:27.791150 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a31f679d-ce45-459f-be61-11541cc91c24 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:27.791603 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a31f679d-ce45-459f-be61-11541cc91c24 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:27.792367 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a31f679d-ce45-459f-be61-11541cc91c24 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:27.792830 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a31f679d-ce45-459f-be61-11541cc91c24 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:27.926111 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-a31f679d-ce45-459f-be61-11541cc91c24 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:43:27.934297 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-a31f679d-ce45-459f-be61-11541cc91c24 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d" status: 200 len: 1507 microversion: 2.1 time: 0.154231 Jun 30 10:43:27.934857 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 257/508] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:43:27 2022] GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:43:28.952428 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-adcf29b6-d4af-4c96-a35f-9daeac760e2e tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:43:28.953264 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-adcf29b6-d4af-4c96-a35f-9daeac760e2e tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 109c8a70-7b89-45b4-8876-a3286375b27d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:43:28.960174 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-adcf29b6-d4af-4c96-a35f-9daeac760e2e tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:28.961007 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-adcf29b6-d4af-4c96-a35f-9daeac760e2e tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:28.961833 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-adcf29b6-d4af-4c96-a35f-9daeac760e2e tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:28.962217 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-adcf29b6-d4af-4c96-a35f-9daeac760e2e tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:29.104472 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-adcf29b6-d4af-4c96-a35f-9daeac760e2e tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:43:29.112108 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-adcf29b6-d4af-4c96-a35f-9daeac760e2e tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d" status: 200 len: 1507 microversion: 2.1 time: 0.163956 Jun 30 10:43:29.112708 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 252/509] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:43:28 2022] GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d => generated 1507 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:43:30.129941 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-5dde1b83-cdab-4f29-bdbc-0790a0b719e4 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:43:30.132183 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-5dde1b83-cdab-4f29-bdbc-0790a0b719e4 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 109c8a70-7b89-45b4-8876-a3286375b27d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:43:30.138517 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-5dde1b83-cdab-4f29-bdbc-0790a0b719e4 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:30.138967 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-5dde1b83-cdab-4f29-bdbc-0790a0b719e4 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:30.139743 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-5dde1b83-cdab-4f29-bdbc-0790a0b719e4 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:30.140182 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-5dde1b83-cdab-4f29-bdbc-0790a0b719e4 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:30.364951 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-5dde1b83-cdab-4f29-bdbc-0790a0b719e4 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:43:30.372428 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-5dde1b83-cdab-4f29-bdbc-0790a0b719e4 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d" status: 200 len: 1513 microversion: 2.1 time: 0.246655 Jun 30 10:43:30.373343 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 258/510] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:43:30 2022] GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d => generated 1513 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:43:31.484406 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-388376a4-5d9e-4ab4-915c-e5706c77fdf6 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:43:31.485562 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-388376a4-5d9e-4ab4-915c-e5706c77fdf6 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] [instance: 6385416e-65e3-4edd-b542-1b8b44cde2e2] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:43:31.492425 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-388376a4-5d9e-4ab4-915c-e5706c77fdf6 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:31.492904 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-388376a4-5d9e-4ab4-915c-e5706c77fdf6 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:31.494291 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-388376a4-5d9e-4ab4-915c-e5706c77fdf6 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:31.494291 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-388376a4-5d9e-4ab4-915c-e5706c77fdf6 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:31.496999 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:43:31.627991 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.objects.instance [None req-388376a4-5d9e-4ab4-915c-e5706c77fdf6 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lazy-loading 'services' on Instance uuid 6385416e-65e3-4edd-b542-1b8b44cde2e2 {{(pid=124204) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 10:43:31.742995 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-388376a4-5d9e-4ab4-915c-e5706c77fdf6 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] 10.222.0.59 "DELETE /compute/v2.1/servers/6385416e-65e3-4edd-b542-1b8b44cde2e2/os-volume_attachments/75e747a7-2959-4a62-a0ca-f16b6de21163" status: 202 len: 0 microversion: 2.1 time: 0.264141 Jun 30 10:43:31.743931 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 253/511] 10.222.0.59 () {58 vars in 1415 bytes} [Thu Jun 30 10:43:31 2022] DELETE /compute/v2.1/servers/6385416e-65e3-4edd-b542-1b8b44cde2e2/os-volume_attachments/75e747a7-2959-4a62-a0ca-f16b6de21163 => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 10:43:31.752471 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-c0539003-f2c6-4a74-a93e-b18157a3ee3a tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Action: 'create', calling method: .version_select at 0x7f4dadec4700>, body: {"keypair": {"name": "tempest-keypair-1899886986", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJUcw5ONiEUML25zI/oX0rKi/Irtvp6AMNsTIF3tNvSyACoZe+QT1qBRRb2fk03313mZYMG0LrDsQDd60CjmCZ2UnzYhIlHHjH2tw+sMUuxsohVbdxUVAlVOSMFksiQSlg=="}} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:43:31.783660 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.quota [None req-c0539003-f2c6-4a74-a93e-b18157a3ee3a tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Getting quotas for project 0e38b1cc4c0d45a8b38ba7b670f83c79. Resources: {'key_pairs'} {{(pid=124203) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 10:43:31.788209 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.quota [None req-c0539003-f2c6-4a74-a93e-b18157a3ee3a tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Getting quotas for user 6c963986b46d4d148fc843b0a1183d69 and project 0e38b1cc4c0d45a8b38ba7b670f83c79. Resources: {'key_pairs'} {{(pid=124203) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 10:43:31.800767 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c0539003-f2c6-4a74-a93e-b18157a3ee3a tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [0c2484db-9864-4376-abcc-61abcd2f5fe5] AMQP server on 10.222.0.59:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 30 10:43:32.810270 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO oslo.messaging._drivers.impl_rabbit [None req-c0539003-f2c6-4a74-a93e-b18157a3ee3a tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [0c2484db-9864-4376-abcc-61abcd2f5fe5] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 50734. Jun 30 10:43:32.824977 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-c0539003-f2c6-4a74-a93e-b18157a3ee3a tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.076803 Jun 30 10:43:32.825814 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 259/512] 10.222.0.59 () {60 vars in 1158 bytes} [Thu Jun 30 10:43:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:43:32.860691 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-946178f1-06bf-4a8c-86ce-de6d0b19f3b8 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:43:32.861268 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-946178f1-06bf-4a8c-86ce-de6d0b19f3b8 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] [instance: 6385416e-65e3-4edd-b542-1b8b44cde2e2] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:43:32.867881 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-946178f1-06bf-4a8c-86ce-de6d0b19f3b8 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:32.868327 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-946178f1-06bf-4a8c-86ce-de6d0b19f3b8 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:32.869113 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-946178f1-06bf-4a8c-86ce-de6d0b19f3b8 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:32.869541 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-946178f1-06bf-4a8c-86ce-de6d0b19f3b8 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:32.894239 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-946178f1-06bf-4a8c-86ce-de6d0b19f3b8 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] [instance: 6385416e-65e3-4edd-b542-1b8b44cde2e2] Going to try to terminate instance {{(pid=124204) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 10:43:32.983335 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-946178f1-06bf-4a8c-86ce-de6d0b19f3b8 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] 10.222.0.59 "DELETE /compute/v2.1/servers/6385416e-65e3-4edd-b542-1b8b44cde2e2" status: 204 len: 0 microversion: 2.1 time: 0.127902 Jun 30 10:43:32.987166 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 254/513] 10.222.0.59 () {58 vars in 1238 bytes} [Thu Jun 30 10:43:32 2022] DELETE /compute/v2.1/servers/6385416e-65e3-4edd-b542-1b8b44cde2e2 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 10:43:32.993035 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-d85a6174-b631-4849-a293-87675f14ec87 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:43:32.993696 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-d85a6174-b631-4849-a293-87675f14ec87 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] [instance: 6385416e-65e3-4edd-b542-1b8b44cde2e2] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:43:33.000199 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-d85a6174-b631-4849-a293-87675f14ec87 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:33.000710 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-d85a6174-b631-4849-a293-87675f14ec87 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:33.001464 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-d85a6174-b631-4849-a293-87675f14ec87 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:33.001983 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-d85a6174-b631-4849-a293-87675f14ec87 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:33.194826 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-d85a6174-b631-4849-a293-87675f14ec87 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048f9b7d3ad84b439fedd0b80bc6c353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7df7b583a4440ebcf76e5cce3dffc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:43:33.202956 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-d85a6174-b631-4849-a293-87675f14ec87 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] 10.222.0.59 "GET /compute/v2.1/servers/6385416e-65e3-4edd-b542-1b8b44cde2e2" status: 200 len: 1513 microversion: 2.1 time: 0.214326 Jun 30 10:43:33.203554 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 260/514] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:43:32 2022] GET /compute/v2.1/servers/6385416e-65e3-4edd-b542-1b8b44cde2e2 => generated 1513 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:43:34.174209 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-b11e40f3-c98d-46d0-bcbf-83d929ea1829 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1754382746", "imageRef": "c473bd04-5a45-4eb7-b6f4-2b5033d4fc1d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8ad12fa2-834f-4c86-9669-8b937fe31721"}], "security_groups": [{"name": "tempest-securitygroup--1332106646"}], "key_name": "tempest-keypair-1899886986", "user_data": "}} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:43:34.221562 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-ae93289d-0d9b-40c7-847f-72e6958ab941 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:43:34.222223 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-ae93289d-0d9b-40c7-847f-72e6958ab941 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] [instance: 6385416e-65e3-4edd-b542-1b8b44cde2e2] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:43:34.228992 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ae93289d-0d9b-40c7-847f-72e6958ab941 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:34.229461 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ae93289d-0d9b-40c7-847f-72e6958ab941 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:34.230293 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ae93289d-0d9b-40c7-847f-72e6958ab941 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:34.231066 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ae93289d-0d9b-40c7-847f-72e6958ab941 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:34.284918 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.network.neutron [None req-b11e40f3-c98d-46d0-bcbf-83d929ea1829 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] validate_networks() for [('8ad12fa2-834f-4c86-9669-8b937fe31721', None, None, None, None, None)] {{(pid=124204) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 10:43:34.443277 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-ae93289d-0d9b-40c7-847f-72e6958ab941 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048f9b7d3ad84b439fedd0b80bc6c353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7df7b583a4440ebcf76e5cce3dffc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:43:34.450866 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-ae93289d-0d9b-40c7-847f-72e6958ab941 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] 10.222.0.59 "GET /compute/v2.1/servers/6385416e-65e3-4edd-b542-1b8b44cde2e2" status: 200 len: 1513 microversion: 2.1 time: 0.233361 Jun 30 10:43:34.451438 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 261/515] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:43:34 2022] GET /compute/v2.1/servers/6385416e-65e3-4edd-b542-1b8b44cde2e2 => generated 1513 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:43:34.705845 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.virt.hardware [None req-b11e40f3-c98d-46d0-bcbf-83d929ea1829 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Flavor limits 0:0:0 {{(pid=124204) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 10:43:34.706266 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.virt.hardware [None req-b11e40f3-c98d-46d0-bcbf-83d929ea1829 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Image limits 0:0:0 {{(pid=124204) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 10:43:34.706769 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.virt.hardware [None req-b11e40f3-c98d-46d0-bcbf-83d929ea1829 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Flavor pref 0:0:0 {{(pid=124204) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 10:43:34.707176 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.virt.hardware [None req-b11e40f3-c98d-46d0-bcbf-83d929ea1829 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Image pref 0:0:0 {{(pid=124204) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 10:43:34.707588 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.virt.hardware [None req-b11e40f3-c98d-46d0-bcbf-83d929ea1829 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124204) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 10:43:34.716163 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-b11e40f3-c98d-46d0-bcbf-83d929ea1829 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:34.716634 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-b11e40f3-c98d-46d0-bcbf-83d929ea1829 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:34.717429 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-b11e40f3-c98d-46d0-bcbf-83d929ea1829 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:34.717859 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-b11e40f3-c98d-46d0-bcbf-83d929ea1829 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:34.734905 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.quota [None req-b11e40f3-c98d-46d0-bcbf-83d929ea1829 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Getting quotas for project 0e38b1cc4c0d45a8b38ba7b670f83c79. Resources: {'instances', 'cores', 'ram'} {{(pid=124204) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 10:43:34.738789 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.quota [None req-b11e40f3-c98d-46d0-bcbf-83d929ea1829 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Getting quotas for user 6c963986b46d4d148fc843b0a1183d69 and project 0e38b1cc4c0d45a8b38ba7b670f83c79. Resources: {'instances', 'cores', 'ram'} {{(pid=124204) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 10:43:34.750075 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-b11e40f3-c98d-46d0-bcbf-83d929ea1829 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Going to run 1 instances... {{(pid=124204) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 10:43:34.752367 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-b11e40f3-c98d-46d0-bcbf-83d929ea1829 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 3ec80ef6-338b-4924-98e0-295bcb858dd9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c473bd04-5a45-4eb7-b6f4-2b5033d4fc1d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124204) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 10:43:34.807679 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-b11e40f3-c98d-46d0-bcbf-83d929ea1829 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.638114 Jun 30 10:43:34.808247 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 255/516] 10.222.0.59 () {60 vars in 1146 bytes} [Thu Jun 30 10:43:34 2022] POST /compute/v2.1/servers => generated 409 bytes in 640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 10:43:34.818381 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-dcb5d72b-cde7-495f-b108-651fb2eb7031 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:43:34.819112 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-dcb5d72b-cde7-495f-b108-651fb2eb7031 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 3ec80ef6-338b-4924-98e0-295bcb858dd9] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:43:34.874738 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-dcb5d72b-cde7-495f-b108-651fb2eb7031 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:43:34.881390 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-dcb5d72b-cde7-495f-b108-651fb2eb7031 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9" status: 200 len: 1246 microversion: 2.1 time: 0.066928 Jun 30 10:43:34.881954 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 262/517] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:43:34 2022] GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9 => generated 1246 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:43:35.468932 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-29ea2f43-db7b-4ecd-bccb-23c806c88c1b tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:43:35.469538 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-29ea2f43-db7b-4ecd-bccb-23c806c88c1b tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] [instance: 6385416e-65e3-4edd-b542-1b8b44cde2e2] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:43:35.475617 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-29ea2f43-db7b-4ecd-bccb-23c806c88c1b tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:35.476062 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-29ea2f43-db7b-4ecd-bccb-23c806c88c1b tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:35.476849 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-29ea2f43-db7b-4ecd-bccb-23c806c88c1b tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:35.477281 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-29ea2f43-db7b-4ecd-bccb-23c806c88c1b tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:35.604432 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-29ea2f43-db7b-4ecd-bccb-23c806c88c1b tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048f9b7d3ad84b439fedd0b80bc6c353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7df7b583a4440ebcf76e5cce3dffc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:43:35.612116 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-29ea2f43-db7b-4ecd-bccb-23c806c88c1b tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] 10.222.0.59 "GET /compute/v2.1/servers/6385416e-65e3-4edd-b542-1b8b44cde2e2" status: 200 len: 1513 microversion: 2.1 time: 0.147654 Jun 30 10:43:35.612720 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 256/518] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:43:35 2022] GET /compute/v2.1/servers/6385416e-65e3-4edd-b542-1b8b44cde2e2 => generated 1513 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:43:35.897901 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-a63fdd06-3b92-4be6-9513-7a16dd55947d tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:43:35.898502 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-a63fdd06-3b92-4be6-9513-7a16dd55947d tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 3ec80ef6-338b-4924-98e0-295bcb858dd9] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:43:35.904423 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a63fdd06-3b92-4be6-9513-7a16dd55947d tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:35.904894 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a63fdd06-3b92-4be6-9513-7a16dd55947d tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:35.905648 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a63fdd06-3b92-4be6-9513-7a16dd55947d tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:35.906174 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a63fdd06-3b92-4be6-9513-7a16dd55947d tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:35.965211 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-a63fdd06-3b92-4be6-9513-7a16dd55947d tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:43:35.972447 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-a63fdd06-3b92-4be6-9513-7a16dd55947d tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9" status: 200 len: 1250 microversion: 2.1 time: 0.078354 Jun 30 10:43:35.973040 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 263/519] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:43:35 2022] GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9 => generated 1250 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:43:36.629038 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-779e15c4-37c8-4967-a9bb-988cf6e9a1b0 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:43:36.629653 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-779e15c4-37c8-4967-a9bb-988cf6e9a1b0 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] [instance: 6385416e-65e3-4edd-b542-1b8b44cde2e2] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:43:36.632161 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:43:36.638423 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-779e15c4-37c8-4967-a9bb-988cf6e9a1b0 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:36.638874 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-779e15c4-37c8-4967-a9bb-988cf6e9a1b0 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:36.639648 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-779e15c4-37c8-4967-a9bb-988cf6e9a1b0 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:36.640086 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-779e15c4-37c8-4967-a9bb-988cf6e9a1b0 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:36.768451 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-779e15c4-37c8-4967-a9bb-988cf6e9a1b0 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048f9b7d3ad84b439fedd0b80bc6c353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7df7b583a4440ebcf76e5cce3dffc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:43:36.776298 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-779e15c4-37c8-4967-a9bb-988cf6e9a1b0 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] 10.222.0.59 "GET /compute/v2.1/servers/6385416e-65e3-4edd-b542-1b8b44cde2e2" status: 200 len: 1513 microversion: 2.1 time: 0.151147 Jun 30 10:43:36.776894 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 257/520] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:43:36 2022] GET /compute/v2.1/servers/6385416e-65e3-4edd-b542-1b8b44cde2e2 => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:43:36.989287 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-2025fca2-0a23-4cc6-8312-54a1ed3e2ded tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:43:36.989905 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-2025fca2-0a23-4cc6-8312-54a1ed3e2ded tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 3ec80ef6-338b-4924-98e0-295bcb858dd9] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:43:36.995870 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-2025fca2-0a23-4cc6-8312-54a1ed3e2ded tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:36.996315 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-2025fca2-0a23-4cc6-8312-54a1ed3e2ded tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:36.997109 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-2025fca2-0a23-4cc6-8312-54a1ed3e2ded tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:36.997538 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-2025fca2-0a23-4cc6-8312-54a1ed3e2ded tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:37.025092 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 10:43:37.025264 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Thu Jun 30 10:43:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 10:43:37.058474 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-2025fca2-0a23-4cc6-8312-54a1ed3e2ded tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:43:37.065939 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-2025fca2-0a23-4cc6-8312-54a1ed3e2ded tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9" status: 200 len: 1250 microversion: 2.1 time: 0.080447 Jun 30 10:43:37.066503 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 264/521] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:43:36 2022] GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9 => generated 1250 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:43:37.793405 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-6ea1d395-af28-4e55-8f36-01b3f2dc4b99 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:43:37.794016 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-6ea1d395-af28-4e55-8f36-01b3f2dc4b99 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] [instance: 6385416e-65e3-4edd-b542-1b8b44cde2e2] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:43:37.801028 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6ea1d395-af28-4e55-8f36-01b3f2dc4b99 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:37.801471 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6ea1d395-af28-4e55-8f36-01b3f2dc4b99 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:37.802232 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6ea1d395-af28-4e55-8f36-01b3f2dc4b99 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:37.803295 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6ea1d395-af28-4e55-8f36-01b3f2dc4b99 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:37.935128 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-6ea1d395-af28-4e55-8f36-01b3f2dc4b99 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048f9b7d3ad84b439fedd0b80bc6c353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7df7b583a4440ebcf76e5cce3dffc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:43:37.946608 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-6ea1d395-af28-4e55-8f36-01b3f2dc4b99 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] 10.222.0.59 "GET /compute/v2.1/servers/6385416e-65e3-4edd-b542-1b8b44cde2e2" status: 200 len: 1513 microversion: 2.1 time: 0.157171 Jun 30 10:43:37.947444 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 258/522] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:43:37 2022] GET /compute/v2.1/servers/6385416e-65e3-4edd-b542-1b8b44cde2e2 => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:43:37.953524 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 10:43:37.953736 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Thu Jun 30 10:43:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 10:43:38.082788 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-a331c8ae-3e78-4617-9ce3-a4f23a1d6bf7 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:43:38.083445 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-a331c8ae-3e78-4617-9ce3-a4f23a1d6bf7 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 3ec80ef6-338b-4924-98e0-295bcb858dd9] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:43:38.090119 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a331c8ae-3e78-4617-9ce3-a4f23a1d6bf7 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:38.090861 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a331c8ae-3e78-4617-9ce3-a4f23a1d6bf7 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:38.091589 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a331c8ae-3e78-4617-9ce3-a4f23a1d6bf7 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:38.092029 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a331c8ae-3e78-4617-9ce3-a4f23a1d6bf7 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:38.159575 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-a331c8ae-3e78-4617-9ce3-a4f23a1d6bf7 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:43:38.167567 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-a331c8ae-3e78-4617-9ce3-a4f23a1d6bf7 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9" status: 200 len: 1304 microversion: 2.1 time: 0.088539 Jun 30 10:43:38.176957 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 265/523] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:43:38 2022] GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9 => generated 1304 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:43:38.963327 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-5b42b48c-81d5-49bb-9abb-a67dd916509b tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:43:38.964117 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-5b42b48c-81d5-49bb-9abb-a67dd916509b tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] [instance: 6385416e-65e3-4edd-b542-1b8b44cde2e2] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:43:38.970770 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5b42b48c-81d5-49bb-9abb-a67dd916509b tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:38.971204 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5b42b48c-81d5-49bb-9abb-a67dd916509b tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:38.971959 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5b42b48c-81d5-49bb-9abb-a67dd916509b tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:38.972513 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5b42b48c-81d5-49bb-9abb-a67dd916509b tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:39.107324 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-5b42b48c-81d5-49bb-9abb-a67dd916509b tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048f9b7d3ad84b439fedd0b80bc6c353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7df7b583a4440ebcf76e5cce3dffc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:43:39.116121 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-5b42b48c-81d5-49bb-9abb-a67dd916509b tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] 10.222.0.59 "GET /compute/v2.1/servers/6385416e-65e3-4edd-b542-1b8b44cde2e2" status: 200 len: 1513 microversion: 2.1 time: 0.156701 Jun 30 10:43:39.116810 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 259/524] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:43:38 2022] GET /compute/v2.1/servers/6385416e-65e3-4edd-b542-1b8b44cde2e2 => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:43:39.184749 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-c75378b4-da75-4a04-87fc-727d4d7e4d20 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:43:39.185355 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-c75378b4-da75-4a04-87fc-727d4d7e4d20 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 3ec80ef6-338b-4924-98e0-295bcb858dd9] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:43:39.191233 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c75378b4-da75-4a04-87fc-727d4d7e4d20 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:39.191677 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c75378b4-da75-4a04-87fc-727d4d7e4d20 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:39.192426 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c75378b4-da75-4a04-87fc-727d4d7e4d20 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:39.192880 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c75378b4-da75-4a04-87fc-727d4d7e4d20 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:39.332472 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-c75378b4-da75-4a04-87fc-727d4d7e4d20 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:43:39.340055 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-c75378b4-da75-4a04-87fc-727d4d7e4d20 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9" status: 200 len: 1372 microversion: 2.1 time: 0.159258 Jun 30 10:43:39.340765 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 266/525] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:43:39 2022] GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9 => generated 1372 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:43:39.390233 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [req-a2857a7f-bf6c-40fd-8d0f-1357de6befdc req-f43c811e-a3d8-4aa7-9954-8fd18813122f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6385416e-65e3-4edd-b542-1b8b44cde2e2", "name": "network-vif-deleted", "tag": "53ed2a07-49c6-458f-a5ea-d7c5dfc5129c"}]} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:43:39.416984 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-a2857a7f-bf6c-40fd-8d0f-1357de6befdc req-f43c811e-a3d8-4aa7-9954-8fd18813122f service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:39.417431 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-a2857a7f-bf6c-40fd-8d0f-1357de6befdc req-f43c811e-a3d8-4aa7-9954-8fd18813122f service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:39.429640 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.compute.server_external_events [req-a2857a7f-bf6c-40fd-8d0f-1357de6befdc req-f43c811e-a3d8-4aa7-9954-8fd18813122f service nova] Creating event network-vif-deleted:53ed2a07-49c6-458f-a5ea-d7c5dfc5129c for instance 6385416e-65e3-4edd-b542-1b8b44cde2e2 on hv-cinder-82282 Jun 30 10:43:39.439524 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [req-a2857a7f-bf6c-40fd-8d0f-1357de6befdc req-f43c811e-a3d8-4aa7-9954-8fd18813122f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053068 Jun 30 10:43:39.440138 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 260/526] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:43:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:43:40.133758 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-c9c7fa83-ca70-4669-984b-1c215e8313df tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:43:40.134372 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-c9c7fa83-ca70-4669-984b-1c215e8313df tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] [instance: 6385416e-65e3-4edd-b542-1b8b44cde2e2] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:43:40.140329 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c9c7fa83-ca70-4669-984b-1c215e8313df tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:40.140814 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c9c7fa83-ca70-4669-984b-1c215e8313df tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:40.141574 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c9c7fa83-ca70-4669-984b-1c215e8313df tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:40.142009 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c9c7fa83-ca70-4669-984b-1c215e8313df tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:40.155797 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.wsgi [None req-c9c7fa83-ca70-4669-984b-1c215e8313df tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] HTTP exception thrown: Instance 6385416e-65e3-4edd-b542-1b8b44cde2e2 could not be found. Jun 30 10:43:40.157342 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-c9c7fa83-ca70-4669-984b-1c215e8313df tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Request method failure captured: Jun 30 10:43:40.157342 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: request: GET /compute/v2.1/servers/6385416e-65e3-4edd-b542-1b8b44cde2e2 HTTP/1.1 Jun 30 10:43:40.157342 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Accept: application/json Jun 30 10:43:40.157342 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Accept-Encoding: identity Jun 30 10:43:40.157342 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Connection: close Jun 30 10:43:40.157342 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Content-Length: 0 Jun 30 10:43:40.157342 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Content-Type: application/json Jun 30 10:43:40.157342 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Host: 10.222.0.59 Jun 30 10:43:40.157342 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Openstack-System-Scope: None Jun 30 10:43:40.157342 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: User-Agent: python-urllib3/1.26.9 Jun 30 10:43:40.157342 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Auth-Token: gAAAAABivX3Z_wtEfzGsLij4beEPl5xgie4iZl6FpSnvGd84GgczYI2OWqYQ-DkMrqlDCEjRq4brmTZdfqqj9Gice6knhYYJwV8_eL7ai-svJpLqw0QWUhRcGmLYbUxxdz7U4QkN2e45z7YC2ewKD3wgy5C1WGR5w9VkScqWgstfozG8gnE88Zk Jun 30 10:43:40.157342 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Domain-Id: None Jun 30 10:43:40.157342 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Domain-Name: None Jun 30 10:43:40.157342 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Identity-Status: Confirmed Jun 30 10:43:40.157342 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Is-Admin-Project: True Jun 30 10:43:40.157342 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Domain-Id: default Jun 30 10:43:40.157342 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Domain-Name: Default Jun 30 10:43:40.157342 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Id: bd7df7b583a4440ebcf76e5cce3dffc3 Jun 30 10:43:40.157342 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1027744078 Jun 30 10:43:40.157342 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Role: member,reader Jun 30 10:43:40.157342 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Roles: member,reader Jun 30 10:43:40.158889 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/bd7df7b583a4440ebcf76e5cce3dffc3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_bd7df7b583a4440ebcf76e5cce3dffc3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/bd7df7b583a4440ebcf76e5cce3dffc3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/bd7df7b583a4440ebcf76e5cce3dffc3"}]}] Jun 30 10:43:40.158889 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant: tempest-VolumesSnapshotTestJSON-1027744078 Jun 30 10:43:40.158889 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant-Id: bd7df7b583a4440ebcf76e5cce3dffc3 Jun 30 10:43:40.158889 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1027744078 Jun 30 10:43:40.158889 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User: tempest-VolumesSnapshotTestJSON-1027744078-project Jun 30 10:43:40.158889 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Domain-Id: default Jun 30 10:43:40.158889 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Domain-Name: Default Jun 30 10:43:40.158889 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Id: 048f9b7d3ad84b439fedd0b80bc6c353 Jun 30 10:43:40.158889 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Name: tempest-VolumesSnapshotTestJSON-1027744078-project Jun 30 10:43:40.158889 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: method: > Jun 30 10:43:40.158889 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: exception: Instance 6385416e-65e3-4edd-b542-1b8b44cde2e2 could not be found. Jun 30 10:43:40.158889 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: action_args: {'id': '6385416e-65e3-4edd-b542-1b8b44cde2e2'} Jun 30 10:43:40.162987 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:43:40.162987 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:43:40.162987 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 10:43:40.162987 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 10:43:40.162987 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 10:43:40.162987 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 10:43:40.162987 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 10:43:40.162987 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 10:43:40.162987 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 10:43:40.162987 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 10:43:40.162987 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6385416e-65e3-4edd-b542-1b8b44cde2e2 could not be found. Jun 30 10:43:40.162987 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:43:40.162987 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:43:40.162987 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:43:40.162987 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:43:40.162987 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:43:40.162987 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:43:40.162987 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:43:40.162987 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:43:40.162987 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:43:40.164347 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:43:40.164347 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 10:43:40.164347 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 10:43:40.164347 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 10:43:40.164347 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 10:43:40.164347 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 10:43:40.164347 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:43:40.164347 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6385416e-65e3-4edd-b542-1b8b44cde2e2 could not be found. Jun 30 10:43:40.164347 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:43:40.164347 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:43:40.164347 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:43:40.164347 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:43:40.164347 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:43:40.164347 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:43:40.164347 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:43:40.164347 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:43:40.164347 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6385416e-65e3-4edd-b542-1b8b44cde2e2 could not be found. Jun 30 10:43:40.164347 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:43:40.165567 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-c9c7fa83-ca70-4669-984b-1c215e8313df tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Returning 404 to user: Instance 6385416e-65e3-4edd-b542-1b8b44cde2e2 could not be found. {{(pid=124203) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:43:40.165567 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-c9c7fa83-ca70-4669-984b-1c215e8313df tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] 10.222.0.59 "GET /compute/v2.1/servers/6385416e-65e3-4edd-b542-1b8b44cde2e2" status: 404 len: 111 microversion: 2.1 time: 0.029378 Jun 30 10:43:40.165567 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 267/527] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:43:40 2022] GET /compute/v2.1/servers/6385416e-65e3-4edd-b542-1b8b44cde2e2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 10:43:40.357717 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-bfa13883-178d-4749-b9ec-1bf23ac71803 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:43:40.358410 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-bfa13883-178d-4749-b9ec-1bf23ac71803 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 3ec80ef6-338b-4924-98e0-295bcb858dd9] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:43:40.364588 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-bfa13883-178d-4749-b9ec-1bf23ac71803 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:40.365535 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-bfa13883-178d-4749-b9ec-1bf23ac71803 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:40.366294 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-bfa13883-178d-4749-b9ec-1bf23ac71803 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:40.366723 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-bfa13883-178d-4749-b9ec-1bf23ac71803 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:40.495607 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-bfa13883-178d-4749-b9ec-1bf23ac71803 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:43:40.503039 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-bfa13883-178d-4749-b9ec-1bf23ac71803 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9" status: 200 len: 1372 microversion: 2.1 time: 0.150317 Jun 30 10:43:40.503884 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 261/528] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:43:40 2022] GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9 => generated 1372 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:43:41.455800 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [req-751a824e-fc73-4546-b8cd-9826f837daaf req-996c4d7a-3a97-439d-98a1-20528b1e44d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ec80ef6-338b-4924-98e0-295bcb858dd9", "tag": "2f91a1b5-27b0-4bf6-8697-1a3c0ec160b5"}]} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:43:41.463671 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-751a824e-fc73-4546-b8cd-9826f837daaf req-996c4d7a-3a97-439d-98a1-20528b1e44d1 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:41.464116 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-751a824e-fc73-4546-b8cd-9826f837daaf req-996c4d7a-3a97-439d-98a1-20528b1e44d1 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:41.477061 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.compute.server_external_events [req-751a824e-fc73-4546-b8cd-9826f837daaf req-996c4d7a-3a97-439d-98a1-20528b1e44d1 service nova] Creating event network-changed:2f91a1b5-27b0-4bf6-8697-1a3c0ec160b5 for instance 3ec80ef6-338b-4924-98e0-295bcb858dd9 on hv-cinder-82282 Jun 30 10:43:41.482340 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [req-751a824e-fc73-4546-b8cd-9826f837daaf req-996c4d7a-3a97-439d-98a1-20528b1e44d1 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030211 Jun 30 10:43:41.483085 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 268/529] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:43:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:43:41.520094 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-0f791e8f-117a-40c3-8c34-415768bc9cac tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:43:41.520745 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-0f791e8f-117a-40c3-8c34-415768bc9cac tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 3ec80ef6-338b-4924-98e0-295bcb858dd9] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:43:41.527638 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-0f791e8f-117a-40c3-8c34-415768bc9cac tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:41.528293 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-0f791e8f-117a-40c3-8c34-415768bc9cac tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:41.529117 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-0f791e8f-117a-40c3-8c34-415768bc9cac tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:41.529558 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-0f791e8f-117a-40c3-8c34-415768bc9cac tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:41.660959 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-0f791e8f-117a-40c3-8c34-415768bc9cac tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:43:41.667757 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-0f791e8f-117a-40c3-8c34-415768bc9cac tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9" status: 200 len: 1372 microversion: 2.1 time: 0.151497 Jun 30 10:43:41.668901 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 262/530] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:43:41 2022] GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9 => generated 1372 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:43:42.684977 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-00f6218a-5cb3-4c89-9754-3be3590a2c7d tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:43:42.685670 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-00f6218a-5cb3-4c89-9754-3be3590a2c7d tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 3ec80ef6-338b-4924-98e0-295bcb858dd9] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:43:42.687561 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=1 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:43:42.694681 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-00f6218a-5cb3-4c89-9754-3be3590a2c7d tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:42.695123 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-00f6218a-5cb3-4c89-9754-3be3590a2c7d tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:42.695875 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-00f6218a-5cb3-4c89-9754-3be3590a2c7d tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:42.696305 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-00f6218a-5cb3-4c89-9754-3be3590a2c7d tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:42.824052 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-00f6218a-5cb3-4c89-9754-3be3590a2c7d tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:43:42.831356 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-00f6218a-5cb3-4c89-9754-3be3590a2c7d tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9" status: 200 len: 1372 microversion: 2.1 time: 0.150657 Jun 30 10:43:42.831915 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 269/531] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:43:42 2022] GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9 => generated 1372 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:43:43.847650 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-e5d6d3fc-f0a2-42e0-906d-d2f97e904661 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:43:43.848290 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-e5d6d3fc-f0a2-42e0-906d-d2f97e904661 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 3ec80ef6-338b-4924-98e0-295bcb858dd9] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:43:43.854905 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-e5d6d3fc-f0a2-42e0-906d-d2f97e904661 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:43.855351 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-e5d6d3fc-f0a2-42e0-906d-d2f97e904661 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:43.856363 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-e5d6d3fc-f0a2-42e0-906d-d2f97e904661 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:43.856824 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-e5d6d3fc-f0a2-42e0-906d-d2f97e904661 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:43.980406 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-e5d6d3fc-f0a2-42e0-906d-d2f97e904661 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:43:43.988016 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-e5d6d3fc-f0a2-42e0-906d-d2f97e904661 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9" status: 200 len: 1372 microversion: 2.1 time: 0.144235 Jun 30 10:43:43.988608 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 263/532] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:43:43 2022] GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9 => generated 1372 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:43:45.004472 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-5fa85f91-10b4-4954-8c22-539ed7488551 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:43:45.005096 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-5fa85f91-10b4-4954-8c22-539ed7488551 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 3ec80ef6-338b-4924-98e0-295bcb858dd9] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:43:45.006962 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_cell0:SELECT=6 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:43:45.012425 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-5fa85f91-10b4-4954-8c22-539ed7488551 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:45.012951 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-5fa85f91-10b4-4954-8c22-539ed7488551 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:45.013699 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-5fa85f91-10b4-4954-8c22-539ed7488551 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:45.014128 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-5fa85f91-10b4-4954-8c22-539ed7488551 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:45.016796 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_cell1:SELECT=98 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:43:45.143768 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-5fa85f91-10b4-4954-8c22-539ed7488551 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:43:45.151975 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-5fa85f91-10b4-4954-8c22-539ed7488551 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9" status: 200 len: 1372 microversion: 2.1 time: 0.151314 Jun 30 10:43:45.152537 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 270/533] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:43:44 2022] GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9 => generated 1372 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:43:46.168778 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-c5eba66d-102f-4adf-bf4e-7a3a082fe512 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:43:46.169394 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-c5eba66d-102f-4adf-bf4e-7a3a082fe512 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 3ec80ef6-338b-4924-98e0-295bcb858dd9] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:43:46.171356 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_cell0:SELECT=2 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:43:46.172000 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_cell0:SELECT=6 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:43:46.179132 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c5eba66d-102f-4adf-bf4e-7a3a082fe512 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:46.179573 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c5eba66d-102f-4adf-bf4e-7a3a082fe512 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:46.180323 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c5eba66d-102f-4adf-bf4e-7a3a082fe512 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:46.180775 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c5eba66d-102f-4adf-bf4e-7a3a082fe512 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:46.497413 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-c5eba66d-102f-4adf-bf4e-7a3a082fe512 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:43:46.504760 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-c5eba66d-102f-4adf-bf4e-7a3a082fe512 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9" status: 200 len: 1372 microversion: 2.1 time: 0.339939 Jun 30 10:43:46.505371 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 264/534] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:43:46 2022] GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9 => generated 1372 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:43:47.521394 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-0c53f4ff-d85b-46aa-b552-8d90eb4e4d5f tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:43:47.521941 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-0c53f4ff-d85b-46aa-b552-8d90eb4e4d5f tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 3ec80ef6-338b-4924-98e0-295bcb858dd9] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:43:47.527989 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0c53f4ff-d85b-46aa-b552-8d90eb4e4d5f tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:47.528441 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0c53f4ff-d85b-46aa-b552-8d90eb4e4d5f tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:47.529233 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0c53f4ff-d85b-46aa-b552-8d90eb4e4d5f tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:47.529670 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0c53f4ff-d85b-46aa-b552-8d90eb4e4d5f tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:47.657108 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-0c53f4ff-d85b-46aa-b552-8d90eb4e4d5f tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:43:47.665249 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-0c53f4ff-d85b-46aa-b552-8d90eb4e4d5f tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9" status: 200 len: 1372 microversion: 2.1 time: 0.147809 Jun 30 10:43:47.665819 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 271/535] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:43:47 2022] GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9 => generated 1372 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:43:48.682427 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-e56d821c-570a-483c-a8e2-9bbfe997ad12 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:43:48.683031 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-e56d821c-570a-483c-a8e2-9bbfe997ad12 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 3ec80ef6-338b-4924-98e0-295bcb858dd9] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:43:48.689587 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-e56d821c-570a-483c-a8e2-9bbfe997ad12 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:48.690021 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-e56d821c-570a-483c-a8e2-9bbfe997ad12 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:48.690769 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-e56d821c-570a-483c-a8e2-9bbfe997ad12 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:48.691193 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-e56d821c-570a-483c-a8e2-9bbfe997ad12 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:48.819866 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-e56d821c-570a-483c-a8e2-9bbfe997ad12 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:43:48.827111 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-e56d821c-570a-483c-a8e2-9bbfe997ad12 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9" status: 200 len: 1372 microversion: 2.1 time: 0.148543 Jun 30 10:43:48.827668 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 265/536] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:43:48 2022] GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9 => generated 1372 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:43:49.843033 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-0b59a07e-9f06-4dfd-bc3f-664a02ca8dfc tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:43:49.843664 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-0b59a07e-9f06-4dfd-bc3f-664a02ca8dfc tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 3ec80ef6-338b-4924-98e0-295bcb858dd9] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:43:49.850659 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0b59a07e-9f06-4dfd-bc3f-664a02ca8dfc tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:49.851103 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0b59a07e-9f06-4dfd-bc3f-664a02ca8dfc tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:49.851860 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0b59a07e-9f06-4dfd-bc3f-664a02ca8dfc tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:49.852296 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0b59a07e-9f06-4dfd-bc3f-664a02ca8dfc tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:49.977511 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-0b59a07e-9f06-4dfd-bc3f-664a02ca8dfc tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:43:49.985013 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-0b59a07e-9f06-4dfd-bc3f-664a02ca8dfc tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9" status: 200 len: 1372 microversion: 2.1 time: 0.145841 Jun 30 10:43:49.985569 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 272/537] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:43:49 2022] GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9 => generated 1372 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:43:51.001989 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-25acddb9-b75f-4491-9e00-6a353ce93ced tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:43:51.002604 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-25acddb9-b75f-4491-9e00-6a353ce93ced tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 3ec80ef6-338b-4924-98e0-295bcb858dd9] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:43:51.009220 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-25acddb9-b75f-4491-9e00-6a353ce93ced tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:51.009671 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-25acddb9-b75f-4491-9e00-6a353ce93ced tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:51.010434 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-25acddb9-b75f-4491-9e00-6a353ce93ced tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:51.010870 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-25acddb9-b75f-4491-9e00-6a353ce93ced tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:51.137646 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-25acddb9-b75f-4491-9e00-6a353ce93ced tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:43:51.144994 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-25acddb9-b75f-4491-9e00-6a353ce93ced tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9" status: 200 len: 1372 microversion: 2.1 time: 0.147054 Jun 30 10:43:51.145557 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 266/538] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:43:50 2022] GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9 => generated 1372 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:43:52.082495 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-2ef12104-d9d2-4b81-9241-c3958eb6fd43 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1958356555", "imageRef": "c473bd04-5a45-4eb7-b6f4-2b5033d4fc1d", "flavorRef": "452", "networks": [{"uuid": "fc8071a8-8a6d-4054-886b-ddb189fb2d83"}]}} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:43:52.132335 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.network.neutron [None req-2ef12104-d9d2-4b81-9241-c3958eb6fd43 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] validate_networks() for [('fc8071a8-8a6d-4054-886b-ddb189fb2d83', None, None, None, None, None)] {{(pid=124203) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 10:43:52.161416 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-8d15772a-e32a-4e66-ae6d-1492a17ae212 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:43:52.162035 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-8d15772a-e32a-4e66-ae6d-1492a17ae212 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 3ec80ef6-338b-4924-98e0-295bcb858dd9] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:43:52.168422 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-8d15772a-e32a-4e66-ae6d-1492a17ae212 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:52.168888 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-8d15772a-e32a-4e66-ae6d-1492a17ae212 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:52.169638 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-8d15772a-e32a-4e66-ae6d-1492a17ae212 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:52.170063 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-8d15772a-e32a-4e66-ae6d-1492a17ae212 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:52.356216 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-8d15772a-e32a-4e66-ae6d-1492a17ae212 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:43:52.363766 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-8d15772a-e32a-4e66-ae6d-1492a17ae212 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9" status: 200 len: 1372 microversion: 2.1 time: 0.206100 Jun 30 10:43:52.364429 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 267/539] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:43:52 2022] GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9 => generated 1372 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:43:52.538696 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.virt.hardware [None req-2ef12104-d9d2-4b81-9241-c3958eb6fd43 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Flavor limits 0:0:0 {{(pid=124203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 10:43:52.539119 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.virt.hardware [None req-2ef12104-d9d2-4b81-9241-c3958eb6fd43 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Image limits 0:0:0 {{(pid=124203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 10:43:52.539588 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.virt.hardware [None req-2ef12104-d9d2-4b81-9241-c3958eb6fd43 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Flavor pref 0:0:0 {{(pid=124203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 10:43:52.539995 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.virt.hardware [None req-2ef12104-d9d2-4b81-9241-c3958eb6fd43 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Image pref 0:0:0 {{(pid=124203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 10:43:52.540404 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.virt.hardware [None req-2ef12104-d9d2-4b81-9241-c3958eb6fd43 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 10:43:52.549392 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-2ef12104-d9d2-4b81-9241-c3958eb6fd43 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:52.549838 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-2ef12104-d9d2-4b81-9241-c3958eb6fd43 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:52.550631 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-2ef12104-d9d2-4b81-9241-c3958eb6fd43 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:52.551275 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-2ef12104-d9d2-4b81-9241-c3958eb6fd43 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:52.569558 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.quota [None req-2ef12104-d9d2-4b81-9241-c3958eb6fd43 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Getting quotas for project bd7df7b583a4440ebcf76e5cce3dffc3. Resources: {'instances', 'cores', 'ram'} {{(pid=124203) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 10:43:52.573553 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.quota [None req-2ef12104-d9d2-4b81-9241-c3958eb6fd43 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Getting quotas for user 048f9b7d3ad84b439fedd0b80bc6c353 and project bd7df7b583a4440ebcf76e5cce3dffc3. Resources: {'instances', 'cores', 'ram'} {{(pid=124203) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 10:43:52.585368 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-2ef12104-d9d2-4b81-9241-c3958eb6fd43 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Going to run 1 instances... {{(pid=124203) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 10:43:52.587640 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-2ef12104-d9d2-4b81-9241-c3958eb6fd43 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] [instance: a7615fd7-dadb-409e-882e-eebf7882712c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c473bd04-5a45-4eb7-b6f4-2b5033d4fc1d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124203) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 10:43:52.636061 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-2ef12104-d9d2-4b81-9241-c3958eb6fd43 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.557173 Jun 30 10:43:52.637016 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 273/540] 10.222.0.59 () {60 vars in 1146 bytes} [Thu Jun 30 10:43:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 559 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 10:43:52.646902 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-7f116d92-3709-42bc-b317-4dc18c44724b tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:43:52.647848 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-7f116d92-3709-42bc-b317-4dc18c44724b tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] [instance: a7615fd7-dadb-409e-882e-eebf7882712c] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:43:52.704361 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-7f116d92-3709-42bc-b317-4dc18c44724b tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048f9b7d3ad84b439fedd0b80bc6c353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7df7b583a4440ebcf76e5cce3dffc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:43:52.711048 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-7f116d92-3709-42bc-b317-4dc18c44724b tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] 10.222.0.59 "GET /compute/v2.1/servers/a7615fd7-dadb-409e-882e-eebf7882712c" status: 200 len: 1219 microversion: 2.1 time: 0.068193 Jun 30 10:43:52.718680 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 268/541] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:43:52 2022] GET /compute/v2.1/servers/a7615fd7-dadb-409e-882e-eebf7882712c => generated 1219 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:43:53.381509 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-de1120af-a341-4e4f-adc0-8af71965fc68 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:43:53.382115 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-de1120af-a341-4e4f-adc0-8af71965fc68 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 3ec80ef6-338b-4924-98e0-295bcb858dd9] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:43:53.388200 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-de1120af-a341-4e4f-adc0-8af71965fc68 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:53.388686 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-de1120af-a341-4e4f-adc0-8af71965fc68 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:53.389433 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-de1120af-a341-4e4f-adc0-8af71965fc68 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:53.389863 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-de1120af-a341-4e4f-adc0-8af71965fc68 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:53.529196 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-de1120af-a341-4e4f-adc0-8af71965fc68 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:43:53.538942 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-de1120af-a341-4e4f-adc0-8af71965fc68 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9" status: 200 len: 1372 microversion: 2.1 time: 0.161703 Jun 30 10:43:53.564416 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 274/542] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:43:53 2022] GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9 => generated 1372 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:43:53.601671 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [req-90770bda-0e13-4a12-8a2b-aef60e79b320 req-ce01ba92-924c-4606-a8c0-0f7108395669 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ec80ef6-338b-4924-98e0-295bcb858dd9", "name": "network-vif-plugged", "status": "completed", "tag": "2f91a1b5-27b0-4bf6-8697-1a3c0ec160b5"}]} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:43:53.613467 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-90770bda-0e13-4a12-8a2b-aef60e79b320 req-ce01ba92-924c-4606-a8c0-0f7108395669 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:53.614358 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-90770bda-0e13-4a12-8a2b-aef60e79b320 req-ce01ba92-924c-4606-a8c0-0f7108395669 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:53.626996 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.compute.server_external_events [req-90770bda-0e13-4a12-8a2b-aef60e79b320 req-ce01ba92-924c-4606-a8c0-0f7108395669 service nova] Creating event network-vif-plugged:2f91a1b5-27b0-4bf6-8697-1a3c0ec160b5 for instance 3ec80ef6-338b-4924-98e0-295bcb858dd9 on hv-cinder-82282 Jun 30 10:43:53.632979 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [req-90770bda-0e13-4a12-8a2b-aef60e79b320 req-ce01ba92-924c-4606-a8c0-0f7108395669 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039558 Jun 30 10:43:53.634319 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 269/543] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:43:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:43:53.727559 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-5cafd2f2-eb7f-4744-beca-889343899524 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:43:53.728464 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-5cafd2f2-eb7f-4744-beca-889343899524 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] [instance: a7615fd7-dadb-409e-882e-eebf7882712c] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:43:53.738911 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-5cafd2f2-eb7f-4744-beca-889343899524 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:53.741195 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-5cafd2f2-eb7f-4744-beca-889343899524 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:53.742328 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-5cafd2f2-eb7f-4744-beca-889343899524 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:53.742801 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-5cafd2f2-eb7f-4744-beca-889343899524 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:53.869246 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-5cafd2f2-eb7f-4744-beca-889343899524 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048f9b7d3ad84b439fedd0b80bc6c353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7df7b583a4440ebcf76e5cce3dffc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:43:53.891269 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-5cafd2f2-eb7f-4744-beca-889343899524 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] 10.222.0.59 "GET /compute/v2.1/servers/a7615fd7-dadb-409e-882e-eebf7882712c" status: 200 len: 1289 microversion: 2.1 time: 0.167874 Jun 30 10:43:53.891837 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 275/544] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:43:53 2022] GET /compute/v2.1/servers/a7615fd7-dadb-409e-882e-eebf7882712c => generated 1289 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:43:54.556926 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-cc7eba06-29a4-47d9-b8b5-95f5ad723ce6 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:43:54.557620 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-cc7eba06-29a4-47d9-b8b5-95f5ad723ce6 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 3ec80ef6-338b-4924-98e0-295bcb858dd9] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:43:54.563655 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-cc7eba06-29a4-47d9-b8b5-95f5ad723ce6 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:54.564092 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-cc7eba06-29a4-47d9-b8b5-95f5ad723ce6 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:54.564871 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-cc7eba06-29a4-47d9-b8b5-95f5ad723ce6 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:54.565321 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-cc7eba06-29a4-47d9-b8b5-95f5ad723ce6 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:54.580794 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:43:54.701647 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-cc7eba06-29a4-47d9-b8b5-95f5ad723ce6 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:43:54.709247 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-cc7eba06-29a4-47d9-b8b5-95f5ad723ce6 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9" status: 200 len: 1372 microversion: 2.1 time: 0.157110 Jun 30 10:43:54.709808 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 270/545] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:43:54 2022] GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9 => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:43:54.908942 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-27914a27-f13f-4dfb-9a8a-6c603d7fdd25 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:43:54.910259 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-27914a27-f13f-4dfb-9a8a-6c603d7fdd25 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] [instance: a7615fd7-dadb-409e-882e-eebf7882712c] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:43:54.916800 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-27914a27-f13f-4dfb-9a8a-6c603d7fdd25 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:54.917241 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-27914a27-f13f-4dfb-9a8a-6c603d7fdd25 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:54.917990 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-27914a27-f13f-4dfb-9a8a-6c603d7fdd25 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:54.918808 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-27914a27-f13f-4dfb-9a8a-6c603d7fdd25 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:55.049015 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-27914a27-f13f-4dfb-9a8a-6c603d7fdd25 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048f9b7d3ad84b439fedd0b80bc6c353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7df7b583a4440ebcf76e5cce3dffc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:43:55.056975 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-27914a27-f13f-4dfb-9a8a-6c603d7fdd25 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] 10.222.0.59 "GET /compute/v2.1/servers/a7615fd7-dadb-409e-882e-eebf7882712c" status: 200 len: 1319 microversion: 2.1 time: 0.151769 Jun 30 10:43:55.057547 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 276/546] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:43:54 2022] GET /compute/v2.1/servers/a7615fd7-dadb-409e-882e-eebf7882712c => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:43:55.087851 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [req-3d577071-1d34-44d7-87d9-cb5afac321bd req-c30ad3f0-f250-4923-868a-672595bf4b56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7615fd7-dadb-409e-882e-eebf7882712c", "tag": "460607b7-c732-494b-b639-bcdc24a473bc"}]} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:43:55.095699 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-3d577071-1d34-44d7-87d9-cb5afac321bd req-c30ad3f0-f250-4923-868a-672595bf4b56 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:55.096204 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-3d577071-1d34-44d7-87d9-cb5afac321bd req-c30ad3f0-f250-4923-868a-672595bf4b56 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:55.110598 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.compute.server_external_events [req-3d577071-1d34-44d7-87d9-cb5afac321bd req-c30ad3f0-f250-4923-868a-672595bf4b56 service nova] Creating event network-changed:460607b7-c732-494b-b639-bcdc24a473bc for instance a7615fd7-dadb-409e-882e-eebf7882712c on hv-cinder-82282 Jun 30 10:43:55.115735 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [req-3d577071-1d34-44d7-87d9-cb5afac321bd req-c30ad3f0-f250-4923-868a-672595bf4b56 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031574 Jun 30 10:43:55.116326 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 271/547] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:43:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 10:43:55.732552 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-e52de176-40a6-47a4-b7c0-ef11ef2858f4 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:43:55.733167 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-e52de176-40a6-47a4-b7c0-ef11ef2858f4 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 3ec80ef6-338b-4924-98e0-295bcb858dd9] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:43:55.739217 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e52de176-40a6-47a4-b7c0-ef11ef2858f4 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:55.739721 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e52de176-40a6-47a4-b7c0-ef11ef2858f4 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:55.740487 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e52de176-40a6-47a4-b7c0-ef11ef2858f4 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:55.740947 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e52de176-40a6-47a4-b7c0-ef11ef2858f4 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:55.864984 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-e52de176-40a6-47a4-b7c0-ef11ef2858f4 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:43:55.872201 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-e52de176-40a6-47a4-b7c0-ef11ef2858f4 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9" status: 200 len: 1372 microversion: 2.1 time: 0.143756 Jun 30 10:43:55.872792 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 277/548] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:43:55 2022] GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9 => generated 1372 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:43:56.075523 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-54d03201-0f2e-4a06-978f-29a08b5eac78 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:43:56.076302 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-54d03201-0f2e-4a06-978f-29a08b5eac78 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] [instance: a7615fd7-dadb-409e-882e-eebf7882712c] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:43:56.082627 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-54d03201-0f2e-4a06-978f-29a08b5eac78 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:56.083072 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-54d03201-0f2e-4a06-978f-29a08b5eac78 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:56.083865 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-54d03201-0f2e-4a06-978f-29a08b5eac78 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:56.084298 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-54d03201-0f2e-4a06-978f-29a08b5eac78 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:56.228000 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-54d03201-0f2e-4a06-978f-29a08b5eac78 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048f9b7d3ad84b439fedd0b80bc6c353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7df7b583a4440ebcf76e5cce3dffc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:43:56.236363 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-54d03201-0f2e-4a06-978f-29a08b5eac78 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] 10.222.0.59 "GET /compute/v2.1/servers/a7615fd7-dadb-409e-882e-eebf7882712c" status: 200 len: 1319 microversion: 2.1 time: 0.165497 Jun 30 10:43:56.237099 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 272/549] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:43:56 2022] GET /compute/v2.1/servers/a7615fd7-dadb-409e-882e-eebf7882712c => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:43:56.888521 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-0f745c63-89fd-470c-8050-a246a7424d11 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:43:56.889124 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-0f745c63-89fd-470c-8050-a246a7424d11 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 3ec80ef6-338b-4924-98e0-295bcb858dd9] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:43:56.895297 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0f745c63-89fd-470c-8050-a246a7424d11 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:56.895801 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0f745c63-89fd-470c-8050-a246a7424d11 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:56.896600 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0f745c63-89fd-470c-8050-a246a7424d11 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:56.897041 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0f745c63-89fd-470c-8050-a246a7424d11 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:57.023836 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-0f745c63-89fd-470c-8050-a246a7424d11 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:43:57.031370 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-0f745c63-89fd-470c-8050-a246a7424d11 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9" status: 200 len: 1566 microversion: 2.1 time: 0.146731 Jun 30 10:43:57.031935 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 278/550] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:43:56 2022] GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9 => generated 1566 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:43:57.048081 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-cd07c7c4-6599-44eb-9b59-95409fcb514c tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:43:57.048603 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-cd07c7c4-6599-44eb-9b59-95409fcb514c tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 3ec80ef6-338b-4924-98e0-295bcb858dd9] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:43:57.055178 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-cd07c7c4-6599-44eb-9b59-95409fcb514c tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:57.055624 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-cd07c7c4-6599-44eb-9b59-95409fcb514c tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:57.056384 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-cd07c7c4-6599-44eb-9b59-95409fcb514c tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:57.056871 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-cd07c7c4-6599-44eb-9b59-95409fcb514c tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:57.133808 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-cd07c7c4-6599-44eb-9b59-95409fcb514c tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089755 Jun 30 10:43:57.134393 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 273/551] 10.222.0.59 () {58 vars in 1274 bytes} [Thu Jun 30 10:43:57 2022] GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:43:57.254042 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-8e319b53-35e7-472d-94a5-df9518bb64c5 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:43:57.254580 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-8e319b53-35e7-472d-94a5-df9518bb64c5 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] [instance: a7615fd7-dadb-409e-882e-eebf7882712c] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:43:57.260750 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-8e319b53-35e7-472d-94a5-df9518bb64c5 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:57.261206 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-8e319b53-35e7-472d-94a5-df9518bb64c5 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:57.261986 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-8e319b53-35e7-472d-94a5-df9518bb64c5 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:57.262423 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-8e319b53-35e7-472d-94a5-df9518bb64c5 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:57.544417 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-8e319b53-35e7-472d-94a5-df9518bb64c5 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048f9b7d3ad84b439fedd0b80bc6c353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7df7b583a4440ebcf76e5cce3dffc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:43:57.552247 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-8e319b53-35e7-472d-94a5-df9518bb64c5 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] 10.222.0.59 "GET /compute/v2.1/servers/a7615fd7-dadb-409e-882e-eebf7882712c" status: 200 len: 1319 microversion: 2.1 time: 0.302126 Jun 30 10:43:57.552850 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 279/552] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:43:57 2022] GET /compute/v2.1/servers/a7615fd7-dadb-409e-882e-eebf7882712c => generated 1319 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:43:58.122001 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [req-643d3a0a-367f-4521-93fc-947cdb0fccd4 req-af9a974a-5bac-4b70-832f-b15e1160f58d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ec80ef6-338b-4924-98e0-295bcb858dd9", "tag": "2f91a1b5-27b0-4bf6-8697-1a3c0ec160b5"}]} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:43:58.130741 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-643d3a0a-367f-4521-93fc-947cdb0fccd4 req-af9a974a-5bac-4b70-832f-b15e1160f58d service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:58.131182 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-643d3a0a-367f-4521-93fc-947cdb0fccd4 req-af9a974a-5bac-4b70-832f-b15e1160f58d service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:58.142175 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.compute.server_external_events [req-643d3a0a-367f-4521-93fc-947cdb0fccd4 req-af9a974a-5bac-4b70-832f-b15e1160f58d service nova] Creating event network-changed:2f91a1b5-27b0-4bf6-8697-1a3c0ec160b5 for instance 3ec80ef6-338b-4924-98e0-295bcb858dd9 on hv-cinder-82282 Jun 30 10:43:58.147873 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [req-643d3a0a-367f-4521-93fc-947cdb0fccd4 req-af9a974a-5bac-4b70-832f-b15e1160f58d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030063 Jun 30 10:43:58.148466 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 274/553] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:43:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:43:58.568726 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-c4c62362-65f5-4255-8e66-3faeec189af4 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:43:58.569318 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-c4c62362-65f5-4255-8e66-3faeec189af4 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] [instance: a7615fd7-dadb-409e-882e-eebf7882712c] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:43:58.575644 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c4c62362-65f5-4255-8e66-3faeec189af4 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:58.576094 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c4c62362-65f5-4255-8e66-3faeec189af4 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:58.576898 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c4c62362-65f5-4255-8e66-3faeec189af4 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:58.577334 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c4c62362-65f5-4255-8e66-3faeec189af4 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:58.711576 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-c4c62362-65f5-4255-8e66-3faeec189af4 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048f9b7d3ad84b439fedd0b80bc6c353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7df7b583a4440ebcf76e5cce3dffc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:43:58.719099 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-c4c62362-65f5-4255-8e66-3faeec189af4 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] 10.222.0.59 "GET /compute/v2.1/servers/a7615fd7-dadb-409e-882e-eebf7882712c" status: 200 len: 1319 microversion: 2.1 time: 0.154276 Jun 30 10:43:58.719668 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 280/554] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:43:58 2022] GET /compute/v2.1/servers/a7615fd7-dadb-409e-882e-eebf7882712c => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:43:59.738178 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-2a46409e-a6d3-4e87-8e00-458af7609cbb tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:43:59.738876 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-2a46409e-a6d3-4e87-8e00-458af7609cbb tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] [instance: a7615fd7-dadb-409e-882e-eebf7882712c] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:43:59.745146 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-2a46409e-a6d3-4e87-8e00-458af7609cbb tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:59.745659 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-2a46409e-a6d3-4e87-8e00-458af7609cbb tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:59.746504 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-2a46409e-a6d3-4e87-8e00-458af7609cbb tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:43:59.747000 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-2a46409e-a6d3-4e87-8e00-458af7609cbb tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:43:59.873842 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-2a46409e-a6d3-4e87-8e00-458af7609cbb tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048f9b7d3ad84b439fedd0b80bc6c353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7df7b583a4440ebcf76e5cce3dffc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:43:59.881452 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-2a46409e-a6d3-4e87-8e00-458af7609cbb tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] 10.222.0.59 "GET /compute/v2.1/servers/a7615fd7-dadb-409e-882e-eebf7882712c" status: 200 len: 1319 microversion: 2.1 time: 0.147985 Jun 30 10:43:59.882018 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 275/555] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:43:59 2022] GET /compute/v2.1/servers/a7615fd7-dadb-409e-882e-eebf7882712c => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:44:00.898115 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-20e98729-e0f6-4816-8c1b-94e26789b4f6 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:44:00.898731 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-20e98729-e0f6-4816-8c1b-94e26789b4f6 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] [instance: a7615fd7-dadb-409e-882e-eebf7882712c] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:44:00.905070 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-20e98729-e0f6-4816-8c1b-94e26789b4f6 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:44:00.905518 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-20e98729-e0f6-4816-8c1b-94e26789b4f6 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:44:00.906278 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-20e98729-e0f6-4816-8c1b-94e26789b4f6 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:44:00.906718 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-20e98729-e0f6-4816-8c1b-94e26789b4f6 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:44:01.042260 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-20e98729-e0f6-4816-8c1b-94e26789b4f6 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048f9b7d3ad84b439fedd0b80bc6c353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7df7b583a4440ebcf76e5cce3dffc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:44:01.049716 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-20e98729-e0f6-4816-8c1b-94e26789b4f6 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] 10.222.0.59 "GET /compute/v2.1/servers/a7615fd7-dadb-409e-882e-eebf7882712c" status: 200 len: 1319 microversion: 2.1 time: 0.155531 Jun 30 10:44:01.050284 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 281/556] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:44:00 2022] GET /compute/v2.1/servers/a7615fd7-dadb-409e-882e-eebf7882712c => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:44:02.067239 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-6e35c860-3489-43e6-835a-fbc4700bba3c tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:44:02.068302 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-6e35c860-3489-43e6-835a-fbc4700bba3c tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] [instance: a7615fd7-dadb-409e-882e-eebf7882712c] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:44:02.075164 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6e35c860-3489-43e6-835a-fbc4700bba3c tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:44:02.075612 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6e35c860-3489-43e6-835a-fbc4700bba3c tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:44:02.076379 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6e35c860-3489-43e6-835a-fbc4700bba3c tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:44:02.076849 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6e35c860-3489-43e6-835a-fbc4700bba3c tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:44:02.202418 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-6e35c860-3489-43e6-835a-fbc4700bba3c tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048f9b7d3ad84b439fedd0b80bc6c353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7df7b583a4440ebcf76e5cce3dffc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:44:02.209799 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-6e35c860-3489-43e6-835a-fbc4700bba3c tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] 10.222.0.59 "GET /compute/v2.1/servers/a7615fd7-dadb-409e-882e-eebf7882712c" status: 200 len: 1319 microversion: 2.1 time: 0.146569 Jun 30 10:44:02.210365 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 276/557] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:44:02 2022] GET /compute/v2.1/servers/a7615fd7-dadb-409e-882e-eebf7882712c => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:44:03.226405 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-9516f084-0def-4aa1-ab80-cea7057193ca tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:44:03.227044 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-9516f084-0def-4aa1-ab80-cea7057193ca tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] [instance: a7615fd7-dadb-409e-882e-eebf7882712c] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:44:03.228924 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_cell0:SELECT=2 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:44:03.229588 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_cell0:SELECT=6 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:44:03.236076 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-9516f084-0def-4aa1-ab80-cea7057193ca tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:44:03.236543 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-9516f084-0def-4aa1-ab80-cea7057193ca tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:44:03.237332 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-9516f084-0def-4aa1-ab80-cea7057193ca tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:44:03.237770 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-9516f084-0def-4aa1-ab80-cea7057193ca tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:44:03.365929 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-9516f084-0def-4aa1-ab80-cea7057193ca tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048f9b7d3ad84b439fedd0b80bc6c353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7df7b583a4440ebcf76e5cce3dffc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:44:03.373279 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-9516f084-0def-4aa1-ab80-cea7057193ca tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] 10.222.0.59 "GET /compute/v2.1/servers/a7615fd7-dadb-409e-882e-eebf7882712c" status: 200 len: 1319 microversion: 2.1 time: 0.150773 Jun 30 10:44:03.373847 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 282/558] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:44:03 2022] GET /compute/v2.1/servers/a7615fd7-dadb-409e-882e-eebf7882712c => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:44:04.390272 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-04189ba5-a8d7-42d4-8aa3-8ff9e2f06fa6 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:44:04.390896 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-04189ba5-a8d7-42d4-8aa3-8ff9e2f06fa6 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] [instance: a7615fd7-dadb-409e-882e-eebf7882712c] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:44:04.392844 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_cell0:SELECT=2 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:44:04.399225 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-04189ba5-a8d7-42d4-8aa3-8ff9e2f06fa6 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:44:04.399668 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-04189ba5-a8d7-42d4-8aa3-8ff9e2f06fa6 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:44:04.400425 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-04189ba5-a8d7-42d4-8aa3-8ff9e2f06fa6 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:44:04.400888 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-04189ba5-a8d7-42d4-8aa3-8ff9e2f06fa6 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:44:04.526076 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-04189ba5-a8d7-42d4-8aa3-8ff9e2f06fa6 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048f9b7d3ad84b439fedd0b80bc6c353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7df7b583a4440ebcf76e5cce3dffc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:44:04.533533 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-04189ba5-a8d7-42d4-8aa3-8ff9e2f06fa6 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] 10.222.0.59 "GET /compute/v2.1/servers/a7615fd7-dadb-409e-882e-eebf7882712c" status: 200 len: 1319 microversion: 2.1 time: 0.147133 Jun 30 10:44:04.534099 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 277/559] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:44:04 2022] GET /compute/v2.1/servers/a7615fd7-dadb-409e-882e-eebf7882712c => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:44:05.551349 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-1e0bf813-6000-49f6-b708-4b3ef9c52109 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:44:05.552839 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-1e0bf813-6000-49f6-b708-4b3ef9c52109 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] [instance: a7615fd7-dadb-409e-882e-eebf7882712c] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:44:05.560149 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-1e0bf813-6000-49f6-b708-4b3ef9c52109 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:44:05.560865 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-1e0bf813-6000-49f6-b708-4b3ef9c52109 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:44:05.561640 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-1e0bf813-6000-49f6-b708-4b3ef9c52109 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:44:05.562073 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-1e0bf813-6000-49f6-b708-4b3ef9c52109 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:44:05.706731 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-1e0bf813-6000-49f6-b708-4b3ef9c52109 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048f9b7d3ad84b439fedd0b80bc6c353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7df7b583a4440ebcf76e5cce3dffc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:44:05.717428 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-1e0bf813-6000-49f6-b708-4b3ef9c52109 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] 10.222.0.59 "GET /compute/v2.1/servers/a7615fd7-dadb-409e-882e-eebf7882712c" status: 200 len: 1319 microversion: 2.1 time: 0.169328 Jun 30 10:44:05.718213 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 283/560] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:44:05 2022] GET /compute/v2.1/servers/a7615fd7-dadb-409e-882e-eebf7882712c => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:44:06.735091 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-56c9b6af-e0f1-4d28-8fec-64bc671c50fa tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:44:06.735704 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-56c9b6af-e0f1-4d28-8fec-64bc671c50fa tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] [instance: a7615fd7-dadb-409e-882e-eebf7882712c] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:44:06.738118 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_api:SELECT=44 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:44:06.743821 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-56c9b6af-e0f1-4d28-8fec-64bc671c50fa tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:44:06.744271 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-56c9b6af-e0f1-4d28-8fec-64bc671c50fa tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:44:06.745065 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-56c9b6af-e0f1-4d28-8fec-64bc671c50fa tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:44:06.745505 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-56c9b6af-e0f1-4d28-8fec-64bc671c50fa tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:44:06.873887 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-56c9b6af-e0f1-4d28-8fec-64bc671c50fa tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048f9b7d3ad84b439fedd0b80bc6c353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7df7b583a4440ebcf76e5cce3dffc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:44:06.881669 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-56c9b6af-e0f1-4d28-8fec-64bc671c50fa tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] 10.222.0.59 "GET /compute/v2.1/servers/a7615fd7-dadb-409e-882e-eebf7882712c" status: 200 len: 1319 microversion: 2.1 time: 0.150255 Jun 30 10:44:06.882231 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 278/561] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:44:06 2022] GET /compute/v2.1/servers/a7615fd7-dadb-409e-882e-eebf7882712c => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:44:07.641929 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [req-1f728cd1-3687-47af-a1ff-61858cefae87 req-65822c25-804d-4a76-b1b3-d23bb1a1ec6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7615fd7-dadb-409e-882e-eebf7882712c", "name": "network-vif-plugged", "status": "completed", "tag": "460607b7-c732-494b-b639-bcdc24a473bc"}]} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:44:07.650579 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-1f728cd1-3687-47af-a1ff-61858cefae87 req-65822c25-804d-4a76-b1b3-d23bb1a1ec6b service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:44:07.651162 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-1f728cd1-3687-47af-a1ff-61858cefae87 req-65822c25-804d-4a76-b1b3-d23bb1a1ec6b service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:44:07.666297 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.compute.server_external_events [req-1f728cd1-3687-47af-a1ff-61858cefae87 req-65822c25-804d-4a76-b1b3-d23bb1a1ec6b service nova] Creating event network-vif-plugged:460607b7-c732-494b-b639-bcdc24a473bc for instance a7615fd7-dadb-409e-882e-eebf7882712c on hv-cinder-82282 Jun 30 10:44:07.671724 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [req-1f728cd1-3687-47af-a1ff-61858cefae87 req-65822c25-804d-4a76-b1b3-d23bb1a1ec6b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033643 Jun 30 10:44:07.673572 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 284/562] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:44:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:44:07.899048 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-8ffc35f6-433e-465a-b096-66d336259232 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:44:07.899766 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-8ffc35f6-433e-465a-b096-66d336259232 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] [instance: a7615fd7-dadb-409e-882e-eebf7882712c] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:44:07.907648 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-8ffc35f6-433e-465a-b096-66d336259232 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:44:07.908099 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-8ffc35f6-433e-465a-b096-66d336259232 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:44:07.908907 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-8ffc35f6-433e-465a-b096-66d336259232 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:44:07.909347 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-8ffc35f6-433e-465a-b096-66d336259232 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:44:08.047262 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-8ffc35f6-433e-465a-b096-66d336259232 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048f9b7d3ad84b439fedd0b80bc6c353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7df7b583a4440ebcf76e5cce3dffc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:44:08.055010 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-8ffc35f6-433e-465a-b096-66d336259232 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] 10.222.0.59 "GET /compute/v2.1/servers/a7615fd7-dadb-409e-882e-eebf7882712c" status: 200 len: 1319 microversion: 2.1 time: 0.160560 Jun 30 10:44:08.055598 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 279/563] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:44:07 2022] GET /compute/v2.1/servers/a7615fd7-dadb-409e-882e-eebf7882712c => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:44:09.073630 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-d4a1a2a2-1934-428e-b360-2999fea8c9c6 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:44:09.074314 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-d4a1a2a2-1934-428e-b360-2999fea8c9c6 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] [instance: a7615fd7-dadb-409e-882e-eebf7882712c] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:44:09.080618 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-d4a1a2a2-1934-428e-b360-2999fea8c9c6 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:44:09.081060 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-d4a1a2a2-1934-428e-b360-2999fea8c9c6 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:44:09.081806 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-d4a1a2a2-1934-428e-b360-2999fea8c9c6 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:44:09.082232 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-d4a1a2a2-1934-428e-b360-2999fea8c9c6 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:44:09.217111 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-d4a1a2a2-1934-428e-b360-2999fea8c9c6 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048f9b7d3ad84b439fedd0b80bc6c353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7df7b583a4440ebcf76e5cce3dffc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:44:09.225248 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-d4a1a2a2-1934-428e-b360-2999fea8c9c6 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] 10.222.0.59 "GET /compute/v2.1/servers/a7615fd7-dadb-409e-882e-eebf7882712c" status: 200 len: 1319 microversion: 2.1 time: 0.155283 Jun 30 10:44:09.225820 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 285/564] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:44:09 2022] GET /compute/v2.1/servers/a7615fd7-dadb-409e-882e-eebf7882712c => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:44:10.243760 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-8bbf5e16-6fb9-4897-b864-42c4ff2f86bc tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:44:10.244363 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-8bbf5e16-6fb9-4897-b864-42c4ff2f86bc tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] [instance: a7615fd7-dadb-409e-882e-eebf7882712c] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:44:10.251935 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-8bbf5e16-6fb9-4897-b864-42c4ff2f86bc tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:44:10.252385 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-8bbf5e16-6fb9-4897-b864-42c4ff2f86bc tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:44:10.253211 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-8bbf5e16-6fb9-4897-b864-42c4ff2f86bc tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:44:10.253652 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-8bbf5e16-6fb9-4897-b864-42c4ff2f86bc tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:44:10.389302 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-8bbf5e16-6fb9-4897-b864-42c4ff2f86bc tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048f9b7d3ad84b439fedd0b80bc6c353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7df7b583a4440ebcf76e5cce3dffc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:44:10.396850 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-8bbf5e16-6fb9-4897-b864-42c4ff2f86bc tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] 10.222.0.59 "GET /compute/v2.1/servers/a7615fd7-dadb-409e-882e-eebf7882712c" status: 200 len: 1507 microversion: 2.1 time: 0.158217 Jun 30 10:44:10.397410 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 280/565] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:44:10 2022] GET /compute/v2.1/servers/a7615fd7-dadb-409e-882e-eebf7882712c => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:44:10.413449 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-2bbec30a-1dda-41a5-8b12-0584c2dacbd3 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d4e2b289-cd42-4e4e-ab3a-618bb1f109d6", "device": "/dev/sdb"}} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:44:10.415017 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-2bbec30a-1dda-41a5-8b12-0584c2dacbd3 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] [instance: a7615fd7-dadb-409e-882e-eebf7882712c] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:44:10.421038 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-2bbec30a-1dda-41a5-8b12-0584c2dacbd3 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:44:10.421484 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-2bbec30a-1dda-41a5-8b12-0584c2dacbd3 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:44:10.422238 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-2bbec30a-1dda-41a5-8b12-0584c2dacbd3 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:44:10.422672 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-2bbec30a-1dda-41a5-8b12-0584c2dacbd3 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:44:10.671187 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:44:10.682572 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-2bbec30a-1dda-41a5-8b12-0584c2dacbd3 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] 10.222.0.59 "POST /compute/v2.1/servers/a7615fd7-dadb-409e-882e-eebf7882712c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272906 Jun 30 10:44:10.683181 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 286/566] 10.222.0.59 () {60 vars in 1322 bytes} [Thu Jun 30 10:44:10 2022] POST /compute/v2.1/servers/a7615fd7-dadb-409e-882e-eebf7882712c/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:44:39.208201 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-44b89af2-8051-4295-aac8-7b287e322787 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:44:39.208719 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-44b89af2-8051-4295-aac8-7b287e322787 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] [instance: a7615fd7-dadb-409e-882e-eebf7882712c] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:44:39.211841 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_api:SELECT=5 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:44:39.212469 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_cell1:SELECT=53 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:44:39.218598 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-44b89af2-8051-4295-aac8-7b287e322787 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:44:39.219048 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-44b89af2-8051-4295-aac8-7b287e322787 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:44:39.219814 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-44b89af2-8051-4295-aac8-7b287e322787 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:44:39.220253 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-44b89af2-8051-4295-aac8-7b287e322787 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:44:39.300980 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.objects.instance [None req-44b89af2-8051-4295-aac8-7b287e322787 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lazy-loading 'services' on Instance uuid a7615fd7-dadb-409e-882e-eebf7882712c {{(pid=124204) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 10:44:39.371310 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-44b89af2-8051-4295-aac8-7b287e322787 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] 10.222.0.59 "DELETE /compute/v2.1/servers/a7615fd7-dadb-409e-882e-eebf7882712c/os-volume_attachments/d4e2b289-cd42-4e4e-ab3a-618bb1f109d6" status: 202 len: 0 microversion: 2.1 time: 0.166793 Jun 30 10:44:39.371894 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 281/567] 10.222.0.59 () {58 vars in 1415 bytes} [Thu Jun 30 10:44:39 2022] DELETE /compute/v2.1/servers/a7615fd7-dadb-409e-882e-eebf7882712c/os-volume_attachments/d4e2b289-cd42-4e4e-ab3a-618bb1f109d6 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 10:44:40.481434 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:44:40.482187 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_cell1:INSERT=1 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:44:40.486572 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-a4c597f2-082c-4828-9c43-d5375b54adb0 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:44:40.487222 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-a4c597f2-082c-4828-9c43-d5375b54adb0 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] [instance: a7615fd7-dadb-409e-882e-eebf7882712c] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:44:40.495958 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a4c597f2-082c-4828-9c43-d5375b54adb0 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:44:40.496414 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a4c597f2-082c-4828-9c43-d5375b54adb0 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:44:40.497233 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a4c597f2-082c-4828-9c43-d5375b54adb0 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:44:40.497719 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a4c597f2-082c-4828-9c43-d5375b54adb0 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:44:40.524373 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-a4c597f2-082c-4828-9c43-d5375b54adb0 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] [instance: a7615fd7-dadb-409e-882e-eebf7882712c] Going to try to terminate instance {{(pid=124203) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 10:44:40.599704 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-a4c597f2-082c-4828-9c43-d5375b54adb0 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] 10.222.0.59 "DELETE /compute/v2.1/servers/a7615fd7-dadb-409e-882e-eebf7882712c" status: 204 len: 0 microversion: 2.1 time: 0.119587 Jun 30 10:44:40.600475 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 287/568] 10.222.0.59 () {58 vars in 1238 bytes} [Thu Jun 30 10:44:40 2022] DELETE /compute/v2.1/servers/a7615fd7-dadb-409e-882e-eebf7882712c => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 10:44:40.609852 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-b8a92eaa-eb02-4963-9718-2d86e31206b2 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:44:40.610559 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-b8a92eaa-eb02-4963-9718-2d86e31206b2 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] [instance: a7615fd7-dadb-409e-882e-eebf7882712c] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:44:40.616879 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-b8a92eaa-eb02-4963-9718-2d86e31206b2 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:44:40.617367 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-b8a92eaa-eb02-4963-9718-2d86e31206b2 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:44:40.618161 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-b8a92eaa-eb02-4963-9718-2d86e31206b2 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:44:40.618583 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-b8a92eaa-eb02-4963-9718-2d86e31206b2 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:44:40.749805 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-b8a92eaa-eb02-4963-9718-2d86e31206b2 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048f9b7d3ad84b439fedd0b80bc6c353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7df7b583a4440ebcf76e5cce3dffc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:44:40.757358 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-b8a92eaa-eb02-4963-9718-2d86e31206b2 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] 10.222.0.59 "GET /compute/v2.1/servers/a7615fd7-dadb-409e-882e-eebf7882712c" status: 200 len: 1513 microversion: 2.1 time: 0.152526 Jun 30 10:44:40.757928 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 282/569] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:44:40 2022] GET /compute/v2.1/servers/a7615fd7-dadb-409e-882e-eebf7882712c => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:44:41.780236 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-dc0da3f2-e2db-4c69-99cc-6047fe6bc692 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:44:41.780236 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-dc0da3f2-e2db-4c69-99cc-6047fe6bc692 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] [instance: a7615fd7-dadb-409e-882e-eebf7882712c] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:44:41.784484 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-dc0da3f2-e2db-4c69-99cc-6047fe6bc692 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:44:41.785105 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-dc0da3f2-e2db-4c69-99cc-6047fe6bc692 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:44:41.786034 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-dc0da3f2-e2db-4c69-99cc-6047fe6bc692 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:44:41.786897 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-dc0da3f2-e2db-4c69-99cc-6047fe6bc692 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:44:42.109623 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-dc0da3f2-e2db-4c69-99cc-6047fe6bc692 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048f9b7d3ad84b439fedd0b80bc6c353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7df7b583a4440ebcf76e5cce3dffc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:44:42.117442 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-dc0da3f2-e2db-4c69-99cc-6047fe6bc692 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] 10.222.0.59 "GET /compute/v2.1/servers/a7615fd7-dadb-409e-882e-eebf7882712c" status: 200 len: 1513 microversion: 2.1 time: 0.346096 Jun 30 10:44:42.117998 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 288/570] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:44:41 2022] GET /compute/v2.1/servers/a7615fd7-dadb-409e-882e-eebf7882712c => generated 1513 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:44:43.134808 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-d235140e-25fc-447c-891d-d5370b2a7739 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:44:43.135539 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-d235140e-25fc-447c-891d-d5370b2a7739 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] [instance: a7615fd7-dadb-409e-882e-eebf7882712c] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:44:43.142717 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d235140e-25fc-447c-891d-d5370b2a7739 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:44:43.143169 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d235140e-25fc-447c-891d-d5370b2a7739 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:44:43.143945 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d235140e-25fc-447c-891d-d5370b2a7739 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:44:43.144381 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d235140e-25fc-447c-891d-d5370b2a7739 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:44:43.271784 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-75082c8e-f94b-41f3-9c1c-5e5431bca63c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:44:43.273143 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-75082c8e-f94b-41f3-9c1c-5e5431bca63c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:44:43.281125 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-75082c8e-f94b-41f3-9c1c-5e5431bca63c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:44:43.281620 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-75082c8e-f94b-41f3-9c1c-5e5431bca63c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:44:43.282402 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-75082c8e-f94b-41f3-9c1c-5e5431bca63c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:44:43.283017 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-75082c8e-f94b-41f3-9c1c-5e5431bca63c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:44:43.291397 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-d235140e-25fc-447c-891d-d5370b2a7739 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048f9b7d3ad84b439fedd0b80bc6c353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7df7b583a4440ebcf76e5cce3dffc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:44:43.301487 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-d235140e-25fc-447c-891d-d5370b2a7739 tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] 10.222.0.59 "GET /compute/v2.1/servers/a7615fd7-dadb-409e-882e-eebf7882712c" status: 200 len: 1513 microversion: 2.1 time: 0.170911 Jun 30 10:44:43.307900 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 283/571] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:44:43 2022] GET /compute/v2.1/servers/a7615fd7-dadb-409e-882e-eebf7882712c => generated 1513 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:44:43.375445 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-75082c8e-f94b-41f3-9c1c-5e5431bca63c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "POST /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8/action" status: 200 len: 32972 microversion: 2.20 time: 0.110121 Jun 30 10:44:43.376016 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 289/572] 10.222.0.59 () {62 vars in 1318 bytes} [Thu Jun 30 10:44:43 2022] POST /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8/action => generated 32972 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jun 30 10:44:43.541026 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [req-5a26f32d-d531-48b2-bda6-86587a813eb7 req-eda7e1c6-825f-42eb-9cbf-c9bf51b147c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7615fd7-dadb-409e-882e-eebf7882712c", "name": "network-vif-deleted", "tag": "460607b7-c732-494b-b639-bcdc24a473bc"}]} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:44:43.550144 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-5a26f32d-d531-48b2-bda6-86587a813eb7 req-eda7e1c6-825f-42eb-9cbf-c9bf51b147c6 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:44:43.550602 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-5a26f32d-d531-48b2-bda6-86587a813eb7 req-eda7e1c6-825f-42eb-9cbf-c9bf51b147c6 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:44:43.564852 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.compute.server_external_events [req-5a26f32d-d531-48b2-bda6-86587a813eb7 req-eda7e1c6-825f-42eb-9cbf-c9bf51b147c6 service nova] Creating event network-vif-deleted:460607b7-c732-494b-b639-bcdc24a473bc for instance a7615fd7-dadb-409e-882e-eebf7882712c on hv-cinder-82282 Jun 30 10:44:43.570341 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [req-5a26f32d-d531-48b2-bda6-86587a813eb7 req-eda7e1c6-825f-42eb-9cbf-c9bf51b147c6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033756 Jun 30 10:44:43.571130 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 284/573] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:44:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:44:44.319148 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-aa65238d-309d-4adf-b3dd-1bb48473360f tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:44:44.319835 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-aa65238d-309d-4adf-b3dd-1bb48473360f tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] [instance: a7615fd7-dadb-409e-882e-eebf7882712c] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:44:44.326843 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-aa65238d-309d-4adf-b3dd-1bb48473360f tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:44:44.327287 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-aa65238d-309d-4adf-b3dd-1bb48473360f tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:44:44.328042 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-aa65238d-309d-4adf-b3dd-1bb48473360f tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:44:44.328470 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-aa65238d-309d-4adf-b3dd-1bb48473360f tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:44:44.343228 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.wsgi [None req-aa65238d-309d-4adf-b3dd-1bb48473360f tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] HTTP exception thrown: Instance a7615fd7-dadb-409e-882e-eebf7882712c could not be found. Jun 30 10:44:44.344856 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-aa65238d-309d-4adf-b3dd-1bb48473360f tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Request method failure captured: Jun 30 10:44:44.344856 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: request: GET /compute/v2.1/servers/a7615fd7-dadb-409e-882e-eebf7882712c HTTP/1.1 Jun 30 10:44:44.344856 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Accept: application/json Jun 30 10:44:44.344856 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Accept-Encoding: identity Jun 30 10:44:44.344856 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Connection: close Jun 30 10:44:44.344856 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Content-Length: 0 Jun 30 10:44:44.344856 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Content-Type: application/json Jun 30 10:44:44.344856 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Host: 10.222.0.59 Jun 30 10:44:44.344856 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Openstack-System-Scope: None Jun 30 10:44:44.344856 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: User-Agent: python-urllib3/1.26.9 Jun 30 10:44:44.344856 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Auth-Token: gAAAAABivX3Z_wtEfzGsLij4beEPl5xgie4iZl6FpSnvGd84GgczYI2OWqYQ-DkMrqlDCEjRq4brmTZdfqqj9Gice6knhYYJwV8_eL7ai-svJpLqw0QWUhRcGmLYbUxxdz7U4QkN2e45z7YC2ewKD3wgy5C1WGR5w9VkScqWgstfozG8gnE88Zk Jun 30 10:44:44.344856 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Domain-Id: None Jun 30 10:44:44.344856 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Domain-Name: None Jun 30 10:44:44.344856 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Identity-Status: Confirmed Jun 30 10:44:44.344856 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Is-Admin-Project: True Jun 30 10:44:44.344856 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Domain-Id: default Jun 30 10:44:44.344856 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Domain-Name: Default Jun 30 10:44:44.344856 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Id: bd7df7b583a4440ebcf76e5cce3dffc3 Jun 30 10:44:44.344856 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1027744078 Jun 30 10:44:44.344856 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Role: member,reader Jun 30 10:44:44.344856 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Roles: member,reader Jun 30 10:44:44.346373 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/bd7df7b583a4440ebcf76e5cce3dffc3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_bd7df7b583a4440ebcf76e5cce3dffc3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/bd7df7b583a4440ebcf76e5cce3dffc3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/bd7df7b583a4440ebcf76e5cce3dffc3"}]}] Jun 30 10:44:44.346373 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant: tempest-VolumesSnapshotTestJSON-1027744078 Jun 30 10:44:44.346373 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant-Id: bd7df7b583a4440ebcf76e5cce3dffc3 Jun 30 10:44:44.346373 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1027744078 Jun 30 10:44:44.346373 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User: tempest-VolumesSnapshotTestJSON-1027744078-project Jun 30 10:44:44.346373 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Domain-Id: default Jun 30 10:44:44.346373 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Domain-Name: Default Jun 30 10:44:44.346373 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Id: 048f9b7d3ad84b439fedd0b80bc6c353 Jun 30 10:44:44.346373 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Name: tempest-VolumesSnapshotTestJSON-1027744078-project Jun 30 10:44:44.346373 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: method: > Jun 30 10:44:44.346373 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: exception: Instance a7615fd7-dadb-409e-882e-eebf7882712c could not be found. Jun 30 10:44:44.346373 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: action_args: {'id': 'a7615fd7-dadb-409e-882e-eebf7882712c'} Jun 30 10:44:44.347273 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:44:44.347273 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:44:44.347273 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 10:44:44.347273 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 10:44:44.347273 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 10:44:44.347273 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 10:44:44.347273 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 10:44:44.347273 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 10:44:44.347273 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 10:44:44.347273 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 10:44:44.347273 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7615fd7-dadb-409e-882e-eebf7882712c could not be found. Jun 30 10:44:44.347273 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:44:44.347273 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:44:44.347273 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:44:44.347273 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:44:44.347273 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:44:44.347273 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:44:44.347273 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:44:44.347273 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:44:44.347273 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:44:44.348753 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:44:44.348753 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 10:44:44.348753 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 10:44:44.348753 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 10:44:44.348753 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 10:44:44.348753 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 10:44:44.348753 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:44:44.348753 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7615fd7-dadb-409e-882e-eebf7882712c could not be found. Jun 30 10:44:44.348753 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:44:44.348753 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:44:44.348753 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:44:44.348753 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:44:44.348753 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:44:44.348753 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:44:44.348753 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:44:44.348753 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:44:44.348753 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7615fd7-dadb-409e-882e-eebf7882712c could not be found. Jun 30 10:44:44.348753 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:44:44.350035 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-aa65238d-309d-4adf-b3dd-1bb48473360f tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] Returning 404 to user: Instance a7615fd7-dadb-409e-882e-eebf7882712c could not be found. {{(pid=124203) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:44:44.350035 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-aa65238d-309d-4adf-b3dd-1bb48473360f tempest-VolumesSnapshotTestJSON-1027744078 tempest-VolumesSnapshotTestJSON-1027744078-project] 10.222.0.59 "GET /compute/v2.1/servers/a7615fd7-dadb-409e-882e-eebf7882712c" status: 404 len: 111 microversion: 2.1 time: 0.031430 Jun 30 10:44:44.350035 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 290/574] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:44:44 2022] GET /compute/v2.1/servers/a7615fd7-dadb-409e-882e-eebf7882712c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 30 10:44:46.471936 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-ceb9ea61-1ebb-4bec-8d42-874425e079c8 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:44:46.472548 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-ceb9ea61-1ebb-4bec-8d42-874425e079c8 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:44:46.479261 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ceb9ea61-1ebb-4bec-8d42-874425e079c8 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:44:46.479715 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ceb9ea61-1ebb-4bec-8d42-874425e079c8 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:44:46.480473 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ceb9ea61-1ebb-4bec-8d42-874425e079c8 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:44:46.480931 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ceb9ea61-1ebb-4bec-8d42-874425e079c8 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:44:46.506073 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-ceb9ea61-1ebb-4bec-8d42-874425e079c8 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8/ips" status: 200 len: 151 microversion: 2.20 time: 0.039325 Jun 30 10:44:46.506739 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 285/575] 10.222.0.59 () {60 vars in 1288 bytes} [Thu Jun 30 10:44:46 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 10:44:49.105330 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-e47aaac4-9535-4fe6-910f-927361b41679 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:44:49.106617 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-e47aaac4-9535-4fe6-910f-927361b41679 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:44:49.113197 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e47aaac4-9535-4fe6-910f-927361b41679 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:44:49.113589 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e47aaac4-9535-4fe6-910f-927361b41679 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:44:49.114346 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e47aaac4-9535-4fe6-910f-927361b41679 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:44:49.114780 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e47aaac4-9535-4fe6-910f-927361b41679 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:44:49.698515 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-c9be9e5e-22c1-46ce-b5f2-16b22a26ef49 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:44:49.699446 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-c9be9e5e-22c1-46ce-b5f2-16b22a26ef49 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 6bc2024c-c05e-4409-a142-e8cf3191a203] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:44:49.706627 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c9be9e5e-22c1-46ce-b5f2-16b22a26ef49 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:44:49.707074 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c9be9e5e-22c1-46ce-b5f2-16b22a26ef49 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:44:49.707828 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c9be9e5e-22c1-46ce-b5f2-16b22a26ef49 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:44:49.708264 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c9be9e5e-22c1-46ce-b5f2-16b22a26ef49 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:44:49.969020 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-e47aaac4-9535-4fe6-910f-927361b41679 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "POST /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725/action" status: 200 len: 28638 microversion: 2.1 time: 0.867655 Jun 30 10:44:49.969598 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 291/576] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Jun 30 10:44:49 2022] POST /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725/action => generated 28638 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 10:44:50.013160 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-c9be9e5e-22c1-46ce-b5f2-16b22a26ef49 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "POST /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203/action" status: 200 len: 28715 microversion: 2.1 time: 0.318295 Jun 30 10:44:50.013793 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 286/577] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Jun 30 10:44:49 2022] POST /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203/action => generated 28715 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 30 10:44:52.564376 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-beb50434-bdec-4540-a822-b9814cb418df tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:44:52.564951 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-beb50434-bdec-4540-a822-b9814cb418df tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:44:52.572155 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-beb50434-bdec-4540-a822-b9814cb418df tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:44:52.572633 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-beb50434-bdec-4540-a822-b9814cb418df tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:44:52.573396 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-beb50434-bdec-4540-a822-b9814cb418df tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:44:52.573829 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-beb50434-bdec-4540-a822-b9814cb418df tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:44:52.598193 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.objects.instance [None req-beb50434-bdec-4540-a822-b9814cb418df tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lazy-loading 'flavor' on Instance uuid af0d59b6-8e95-4947-803a-c1d952e218c8 {{(pid=124203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 10:44:52.853243 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-beb50434-bdec-4540-a822-b9814cb418df tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "POST /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8/action" status: 202 len: 0 microversion: 2.20 time: 0.293090 Jun 30 10:44:52.853880 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 292/578] 10.222.0.59 () {62 vars in 1318 bytes} [Thu Jun 30 10:44:52 2022] POST /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8/action => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 30 10:44:52.862866 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-5ca164d7-1238-41b2-8b73-d8a8338b90cd tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:44:52.863688 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-5ca164d7-1238-41b2-8b73-d8a8338b90cd tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:44:52.871548 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5ca164d7-1238-41b2-8b73-d8a8338b90cd tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:44:52.872771 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5ca164d7-1238-41b2-8b73-d8a8338b90cd tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:44:52.873369 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5ca164d7-1238-41b2-8b73-d8a8338b90cd tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:44:52.873808 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5ca164d7-1238-41b2-8b73-d8a8338b90cd tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:44:53.005061 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-5ca164d7-1238-41b2-8b73-d8a8338b90cd tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:44:53.013487 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-5ca164d7-1238-41b2-8b73-d8a8338b90cd tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:44:53.014998 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-5ca164d7-1238-41b2-8b73-d8a8338b90cd tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:44:53.016161 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-5ca164d7-1238-41b2-8b73-d8a8338b90cd tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1723 microversion: 2.20 time: 0.157591 Jun 30 10:44:53.016753 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 287/579] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:44:52 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:44:54.035645 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-75c49fc7-597f-4b47-b4ea-58a9a0c2e227 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:44:54.036353 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-75c49fc7-597f-4b47-b4ea-58a9a0c2e227 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:44:54.042720 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-75c49fc7-597f-4b47-b4ea-58a9a0c2e227 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:44:54.043155 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-75c49fc7-597f-4b47-b4ea-58a9a0c2e227 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:44:54.044457 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-75c49fc7-597f-4b47-b4ea-58a9a0c2e227 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:44:54.044916 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-75c49fc7-597f-4b47-b4ea-58a9a0c2e227 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:44:54.175814 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-75c49fc7-597f-4b47-b4ea-58a9a0c2e227 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:44:54.183583 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-75c49fc7-597f-4b47-b4ea-58a9a0c2e227 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:44:54.185093 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-75c49fc7-597f-4b47-b4ea-58a9a0c2e227 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:44:54.186261 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-75c49fc7-597f-4b47-b4ea-58a9a0c2e227 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1723 microversion: 2.20 time: 0.155389 Jun 30 10:44:54.186825 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 293/580] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:44:54 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:44:55.205059 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-92815a93-f0e1-490e-92c3-c45384c998ba tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:44:55.205674 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-92815a93-f0e1-490e-92c3-c45384c998ba tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:44:55.212156 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-92815a93-f0e1-490e-92c3-c45384c998ba tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:44:55.212644 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-92815a93-f0e1-490e-92c3-c45384c998ba tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:44:55.213407 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-92815a93-f0e1-490e-92c3-c45384c998ba tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:44:55.213846 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-92815a93-f0e1-490e-92c3-c45384c998ba tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:44:55.338653 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-92815a93-f0e1-490e-92c3-c45384c998ba tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:44:55.347249 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-92815a93-f0e1-490e-92c3-c45384c998ba tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:44:55.348812 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-92815a93-f0e1-490e-92c3-c45384c998ba tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:44:55.349970 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-92815a93-f0e1-490e-92c3-c45384c998ba tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1723 microversion: 2.20 time: 0.148888 Jun 30 10:44:55.350530 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 288/581] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:44:55 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:44:56.368786 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-8ca683a3-2c1e-4f08-9b4c-f75e3ad9d9a8 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:44:56.369385 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-8ca683a3-2c1e-4f08-9b4c-f75e3ad9d9a8 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:44:56.375990 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-8ca683a3-2c1e-4f08-9b4c-f75e3ad9d9a8 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:44:56.376430 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-8ca683a3-2c1e-4f08-9b4c-f75e3ad9d9a8 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:44:56.377214 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-8ca683a3-2c1e-4f08-9b4c-f75e3ad9d9a8 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:44:56.377662 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-8ca683a3-2c1e-4f08-9b4c-f75e3ad9d9a8 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:44:56.505166 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-8ca683a3-2c1e-4f08-9b4c-f75e3ad9d9a8 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:44:56.513276 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-8ca683a3-2c1e-4f08-9b4c-f75e3ad9d9a8 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:44:56.514726 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-8ca683a3-2c1e-4f08-9b4c-f75e3ad9d9a8 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:44:56.515873 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-8ca683a3-2c1e-4f08-9b4c-f75e3ad9d9a8 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1723 microversion: 2.20 time: 0.151011 Jun 30 10:44:56.516552 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 294/582] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:44:56 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:44:57.534052 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-cc6cb8f1-aafd-4b77-bffe-0acb000e8167 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:44:57.534576 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-cc6cb8f1-aafd-4b77-bffe-0acb000e8167 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:44:57.540994 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-cc6cb8f1-aafd-4b77-bffe-0acb000e8167 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:44:57.541440 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-cc6cb8f1-aafd-4b77-bffe-0acb000e8167 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:44:57.542185 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-cc6cb8f1-aafd-4b77-bffe-0acb000e8167 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:44:57.542677 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-cc6cb8f1-aafd-4b77-bffe-0acb000e8167 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:44:57.671620 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-cc6cb8f1-aafd-4b77-bffe-0acb000e8167 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:44:57.679376 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-cc6cb8f1-aafd-4b77-bffe-0acb000e8167 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:44:57.680880 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-cc6cb8f1-aafd-4b77-bffe-0acb000e8167 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:44:57.682021 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-cc6cb8f1-aafd-4b77-bffe-0acb000e8167 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1723 microversion: 2.20 time: 0.151969 Jun 30 10:44:57.682577 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 289/583] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:44:57 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:44:58.701281 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-ca135867-1458-4cf1-b469-a752ab7c3d0b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:44:58.701887 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-ca135867-1458-4cf1-b469-a752ab7c3d0b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:44:58.708276 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ca135867-1458-4cf1-b469-a752ab7c3d0b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:44:58.708761 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ca135867-1458-4cf1-b469-a752ab7c3d0b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:44:58.709518 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ca135867-1458-4cf1-b469-a752ab7c3d0b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:44:58.709952 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ca135867-1458-4cf1-b469-a752ab7c3d0b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:44:59.012704 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-ca135867-1458-4cf1-b469-a752ab7c3d0b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:44:59.020871 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-ca135867-1458-4cf1-b469-a752ab7c3d0b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:44:59.022478 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-ca135867-1458-4cf1-b469-a752ab7c3d0b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:44:59.023618 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-ca135867-1458-4cf1-b469-a752ab7c3d0b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1723 microversion: 2.20 time: 0.326934 Jun 30 10:44:59.024344 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 295/584] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:44:58 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1723 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:45:00.041841 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-721f8cb3-d85b-4713-8ff7-ce89c741176e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:00.042820 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-721f8cb3-d85b-4713-8ff7-ce89c741176e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:00.049040 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-721f8cb3-d85b-4713-8ff7-ce89c741176e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:00.049488 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-721f8cb3-d85b-4713-8ff7-ce89c741176e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:00.050248 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-721f8cb3-d85b-4713-8ff7-ce89c741176e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:00.050681 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-721f8cb3-d85b-4713-8ff7-ce89c741176e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:00.182928 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-721f8cb3-d85b-4713-8ff7-ce89c741176e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:00.192076 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-721f8cb3-d85b-4713-8ff7-ce89c741176e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:00.193615 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-721f8cb3-d85b-4713-8ff7-ce89c741176e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:00.194776 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-721f8cb3-d85b-4713-8ff7-ce89c741176e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1723 microversion: 2.20 time: 0.156965 Jun 30 10:45:00.195339 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 290/585] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:45:00 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:45:01.213968 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-5a3bf70b-4606-42b9-8b44-863fd5942a82 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:01.214582 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-5a3bf70b-4606-42b9-8b44-863fd5942a82 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:01.220979 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-5a3bf70b-4606-42b9-8b44-863fd5942a82 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:01.221425 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-5a3bf70b-4606-42b9-8b44-863fd5942a82 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:01.222178 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-5a3bf70b-4606-42b9-8b44-863fd5942a82 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:01.222608 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-5a3bf70b-4606-42b9-8b44-863fd5942a82 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:01.348083 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-5a3bf70b-4606-42b9-8b44-863fd5942a82 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:01.356453 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-5a3bf70b-4606-42b9-8b44-863fd5942a82 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:01.358004 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-5a3bf70b-4606-42b9-8b44-863fd5942a82 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:01.359156 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-5a3bf70b-4606-42b9-8b44-863fd5942a82 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1723 microversion: 2.20 time: 0.149096 Jun 30 10:45:01.359711 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 296/586] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:45:01 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:45:02.378245 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-d41155fb-640a-4e58-b6f2-32e570dddd7a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:02.378850 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-d41155fb-640a-4e58-b6f2-32e570dddd7a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:02.385302 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d41155fb-640a-4e58-b6f2-32e570dddd7a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:02.385739 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d41155fb-640a-4e58-b6f2-32e570dddd7a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:02.386488 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d41155fb-640a-4e58-b6f2-32e570dddd7a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:02.386914 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d41155fb-640a-4e58-b6f2-32e570dddd7a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:02.568387 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-d41155fb-640a-4e58-b6f2-32e570dddd7a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:02.578282 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-d41155fb-640a-4e58-b6f2-32e570dddd7a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:02.579233 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-d41155fb-640a-4e58-b6f2-32e570dddd7a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:02.580418 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-d41155fb-640a-4e58-b6f2-32e570dddd7a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1723 microversion: 2.20 time: 0.206185 Jun 30 10:45:02.580994 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 291/587] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:45:02 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1723 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:45:03.598278 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-5a10072f-5133-4770-9604-3c8c94c81a2b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:03.598816 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-5a10072f-5133-4770-9604-3c8c94c81a2b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:03.605455 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-5a10072f-5133-4770-9604-3c8c94c81a2b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:03.605921 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-5a10072f-5133-4770-9604-3c8c94c81a2b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:03.607224 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-5a10072f-5133-4770-9604-3c8c94c81a2b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:03.607659 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-5a10072f-5133-4770-9604-3c8c94c81a2b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:03.733125 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-5a10072f-5133-4770-9604-3c8c94c81a2b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:03.741221 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-5a10072f-5133-4770-9604-3c8c94c81a2b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:03.742823 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-5a10072f-5133-4770-9604-3c8c94c81a2b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:03.744075 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-5a10072f-5133-4770-9604-3c8c94c81a2b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1723 microversion: 2.20 time: 0.149725 Jun 30 10:45:03.744978 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 297/588] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:45:03 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:45:04.763769 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-cb025e2b-f797-4a3d-8462-2bbffe0074c1 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:04.764325 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-cb025e2b-f797-4a3d-8462-2bbffe0074c1 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:04.770822 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-cb025e2b-f797-4a3d-8462-2bbffe0074c1 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:04.771277 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-cb025e2b-f797-4a3d-8462-2bbffe0074c1 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:04.772065 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-cb025e2b-f797-4a3d-8462-2bbffe0074c1 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:04.772486 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-cb025e2b-f797-4a3d-8462-2bbffe0074c1 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:04.909906 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-cb025e2b-f797-4a3d-8462-2bbffe0074c1 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:04.919795 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-cb025e2b-f797-4a3d-8462-2bbffe0074c1 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:04.921577 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-cb025e2b-f797-4a3d-8462-2bbffe0074c1 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:04.922924 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-cb025e2b-f797-4a3d-8462-2bbffe0074c1 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1723 microversion: 2.20 time: 0.163156 Jun 30 10:45:04.923607 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 292/589] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:45:04 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:45:05.940855 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-b01010a6-7196-424f-802a-5122fec4ec00 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:05.941437 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-b01010a6-7196-424f-802a-5122fec4ec00 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:05.947899 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b01010a6-7196-424f-802a-5122fec4ec00 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:05.948340 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b01010a6-7196-424f-802a-5122fec4ec00 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:05.949132 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b01010a6-7196-424f-802a-5122fec4ec00 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:05.949568 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b01010a6-7196-424f-802a-5122fec4ec00 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:06.081130 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-b01010a6-7196-424f-802a-5122fec4ec00 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:06.089212 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-b01010a6-7196-424f-802a-5122fec4ec00 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:06.090695 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-b01010a6-7196-424f-802a-5122fec4ec00 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:06.091844 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-b01010a6-7196-424f-802a-5122fec4ec00 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1723 microversion: 2.20 time: 0.155004 Jun 30 10:45:06.092387 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 298/590] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:45:05 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:45:07.110611 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-d500b930-c155-492d-94ae-afeedbd641e4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:07.111222 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-d500b930-c155-492d-94ae-afeedbd641e4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:07.117724 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d500b930-c155-492d-94ae-afeedbd641e4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:07.118177 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d500b930-c155-492d-94ae-afeedbd641e4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:07.119332 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d500b930-c155-492d-94ae-afeedbd641e4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:07.119442 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d500b930-c155-492d-94ae-afeedbd641e4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:07.252638 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-d500b930-c155-492d-94ae-afeedbd641e4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:07.262593 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-d500b930-c155-492d-94ae-afeedbd641e4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:07.264814 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-d500b930-c155-492d-94ae-afeedbd641e4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:07.266001 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-d500b930-c155-492d-94ae-afeedbd641e4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1723 microversion: 2.20 time: 0.160150 Jun 30 10:45:07.266572 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 293/591] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:45:07 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:45:08.284450 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-d0668afa-2cc9-499e-bfff-2d27bd4ab8de tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:08.285097 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-d0668afa-2cc9-499e-bfff-2d27bd4ab8de tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:08.291595 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-d0668afa-2cc9-499e-bfff-2d27bd4ab8de tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:08.292051 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-d0668afa-2cc9-499e-bfff-2d27bd4ab8de tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:08.292842 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-d0668afa-2cc9-499e-bfff-2d27bd4ab8de tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:08.293284 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-d0668afa-2cc9-499e-bfff-2d27bd4ab8de tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:08.431008 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-d0668afa-2cc9-499e-bfff-2d27bd4ab8de tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:08.437879 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-d0668afa-2cc9-499e-bfff-2d27bd4ab8de tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:08.439375 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-d0668afa-2cc9-499e-bfff-2d27bd4ab8de tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:08.442522 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-d0668afa-2cc9-499e-bfff-2d27bd4ab8de tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1723 microversion: 2.20 time: 0.159963 Jun 30 10:45:08.442522 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 299/592] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:45:08 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:45:09.460450 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-76fed4e4-e1df-476a-b72c-91e3856e53d5 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:09.461083 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-76fed4e4-e1df-476a-b72c-91e3856e53d5 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:09.463478 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_api:SELECT=27 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:45:09.469826 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-76fed4e4-e1df-476a-b72c-91e3856e53d5 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:09.470267 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-76fed4e4-e1df-476a-b72c-91e3856e53d5 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:09.471053 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-76fed4e4-e1df-476a-b72c-91e3856e53d5 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:09.471480 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-76fed4e4-e1df-476a-b72c-91e3856e53d5 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:09.475637 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_cell1:SELECT=74,nova_cell1:INSERT=1 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:45:09.599087 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-76fed4e4-e1df-476a-b72c-91e3856e53d5 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:09.607330 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-76fed4e4-e1df-476a-b72c-91e3856e53d5 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:09.608864 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-76fed4e4-e1df-476a-b72c-91e3856e53d5 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:09.610035 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-76fed4e4-e1df-476a-b72c-91e3856e53d5 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1723 microversion: 2.20 time: 0.153428 Jun 30 10:45:09.610602 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 294/593] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:45:09 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:45:10.633027 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-d01ac473-c287-4232-b1f9-f17938726d23 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:10.633629 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-d01ac473-c287-4232-b1f9-f17938726d23 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:10.636017 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:45:10.642006 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-d01ac473-c287-4232-b1f9-f17938726d23 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:10.642423 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-d01ac473-c287-4232-b1f9-f17938726d23 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:10.643286 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-d01ac473-c287-4232-b1f9-f17938726d23 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:10.643598 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-d01ac473-c287-4232-b1f9-f17938726d23 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:10.646980 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:45:10.778519 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-d01ac473-c287-4232-b1f9-f17938726d23 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:10.786572 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-d01ac473-c287-4232-b1f9-f17938726d23 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:10.788152 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-d01ac473-c287-4232-b1f9-f17938726d23 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:10.789434 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-d01ac473-c287-4232-b1f9-f17938726d23 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1744 microversion: 2.20 time: 0.160236 Jun 30 10:45:10.790022 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 300/594] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:45:10 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1744 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:45:11.807173 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-d32e03ad-d363-45e5-a136-47e9d30d0720 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:11.807897 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-d32e03ad-d363-45e5-a136-47e9d30d0720 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:11.814547 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d32e03ad-d363-45e5-a136-47e9d30d0720 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:11.814994 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d32e03ad-d363-45e5-a136-47e9d30d0720 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:11.815744 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d32e03ad-d363-45e5-a136-47e9d30d0720 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:11.816168 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d32e03ad-d363-45e5-a136-47e9d30d0720 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:11.947348 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-d32e03ad-d363-45e5-a136-47e9d30d0720 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:11.956123 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-d32e03ad-d363-45e5-a136-47e9d30d0720 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:11.957731 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-d32e03ad-d363-45e5-a136-47e9d30d0720 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:11.958895 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-d32e03ad-d363-45e5-a136-47e9d30d0720 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1744 microversion: 2.20 time: 0.155659 Jun 30 10:45:11.959554 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 295/595] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:45:11 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:45:12.977329 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-3911b6e0-e8c0-4078-8219-4a22a6281a73 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:12.977941 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-3911b6e0-e8c0-4078-8219-4a22a6281a73 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:12.984759 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-3911b6e0-e8c0-4078-8219-4a22a6281a73 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:12.985215 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-3911b6e0-e8c0-4078-8219-4a22a6281a73 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:12.985979 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-3911b6e0-e8c0-4078-8219-4a22a6281a73 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:12.986421 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-3911b6e0-e8c0-4078-8219-4a22a6281a73 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:13.112718 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-3911b6e0-e8c0-4078-8219-4a22a6281a73 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:13.120577 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-3911b6e0-e8c0-4078-8219-4a22a6281a73 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:13.122181 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-3911b6e0-e8c0-4078-8219-4a22a6281a73 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:13.123806 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-3911b6e0-e8c0-4078-8219-4a22a6281a73 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1744 microversion: 2.20 time: 0.150426 Jun 30 10:45:13.124581 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 301/596] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:45:12 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1744 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:45:14.142538 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-a881780a-aeb5-4c85-94f9-5afd332dd4e4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:14.143164 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-a881780a-aeb5-4c85-94f9-5afd332dd4e4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:14.149623 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a881780a-aeb5-4c85-94f9-5afd332dd4e4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:14.150072 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a881780a-aeb5-4c85-94f9-5afd332dd4e4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:14.150822 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a881780a-aeb5-4c85-94f9-5afd332dd4e4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:14.151253 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a881780a-aeb5-4c85-94f9-5afd332dd4e4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:14.275211 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-a881780a-aeb5-4c85-94f9-5afd332dd4e4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:14.283733 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-a881780a-aeb5-4c85-94f9-5afd332dd4e4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:14.285267 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-a881780a-aeb5-4c85-94f9-5afd332dd4e4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:14.286450 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-a881780a-aeb5-4c85-94f9-5afd332dd4e4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1744 microversion: 2.20 time: 0.148244 Jun 30 10:45:14.287000 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 296/597] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:45:14 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1744 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:45:15.305179 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-a34e18f7-17e4-404e-9008-417bb8ff5a87 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:15.305782 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-a34e18f7-17e4-404e-9008-417bb8ff5a87 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:15.312538 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a34e18f7-17e4-404e-9008-417bb8ff5a87 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:15.312981 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a34e18f7-17e4-404e-9008-417bb8ff5a87 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:15.313736 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a34e18f7-17e4-404e-9008-417bb8ff5a87 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:15.314169 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a34e18f7-17e4-404e-9008-417bb8ff5a87 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:15.440671 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-a34e18f7-17e4-404e-9008-417bb8ff5a87 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:15.448990 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-a34e18f7-17e4-404e-9008-417bb8ff5a87 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:15.450475 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-a34e18f7-17e4-404e-9008-417bb8ff5a87 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:15.452112 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-a34e18f7-17e4-404e-9008-417bb8ff5a87 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1744 microversion: 2.20 time: 0.150560 Jun 30 10:45:15.452689 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 302/598] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:45:15 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1744 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:45:16.470612 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-6b38a963-0ec7-4282-96e3-967cdb546ca8 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:16.471222 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-6b38a963-0ec7-4282-96e3-967cdb546ca8 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:16.477758 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6b38a963-0ec7-4282-96e3-967cdb546ca8 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:16.478208 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6b38a963-0ec7-4282-96e3-967cdb546ca8 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:16.478968 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6b38a963-0ec7-4282-96e3-967cdb546ca8 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:16.479405 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6b38a963-0ec7-4282-96e3-967cdb546ca8 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:16.604918 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-6b38a963-0ec7-4282-96e3-967cdb546ca8 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:16.613839 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-6b38a963-0ec7-4282-96e3-967cdb546ca8 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:16.615338 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-6b38a963-0ec7-4282-96e3-967cdb546ca8 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:16.616488 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-6b38a963-0ec7-4282-96e3-967cdb546ca8 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1744 microversion: 2.20 time: 0.150080 Jun 30 10:45:16.617065 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 297/599] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:45:16 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1744 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:45:17.459778 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [req-ffdeddbc-3ce2-4368-aa55-c9644aed7fc2 req-0fe3ac89-0361-49e4-81d1-bb360a5d69ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af0d59b6-8e95-4947-803a-c1d952e218c8", "name": "network-vif-plugged", "status": "completed", "tag": "ec009e37-3070-46e8-8a9a-513065a2c654"}]} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:45:17.468932 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-ffdeddbc-3ce2-4368-aa55-c9644aed7fc2 req-0fe3ac89-0361-49e4-81d1-bb360a5d69ae service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:17.469352 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-ffdeddbc-3ce2-4368-aa55-c9644aed7fc2 req-0fe3ac89-0361-49e4-81d1-bb360a5d69ae service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:17.480341 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.compute.server_external_events [req-ffdeddbc-3ce2-4368-aa55-c9644aed7fc2 req-0fe3ac89-0361-49e4-81d1-bb360a5d69ae service nova] Creating event network-vif-plugged:ec009e37-3070-46e8-8a9a-513065a2c654 for instance af0d59b6-8e95-4947-803a-c1d952e218c8 on hv-cinder-82282 Jun 30 10:45:17.486173 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [req-ffdeddbc-3ce2-4368-aa55-c9644aed7fc2 req-0fe3ac89-0361-49e4-81d1-bb360a5d69ae service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030115 Jun 30 10:45:17.486944 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 303/600] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:45:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:45:17.793194 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-ebb86c4d-2ce3-462d-b488-5b5a3dac011a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:17.793796 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-ebb86c4d-2ce3-462d-b488-5b5a3dac011a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:17.799662 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ebb86c4d-2ce3-462d-b488-5b5a3dac011a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:17.800096 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ebb86c4d-2ce3-462d-b488-5b5a3dac011a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:17.800874 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ebb86c4d-2ce3-462d-b488-5b5a3dac011a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:17.801304 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ebb86c4d-2ce3-462d-b488-5b5a3dac011a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:17.935226 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-ebb86c4d-2ce3-462d-b488-5b5a3dac011a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:17.943017 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-ebb86c4d-2ce3-462d-b488-5b5a3dac011a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:17.944511 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-ebb86c4d-2ce3-462d-b488-5b5a3dac011a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:17.945689 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-ebb86c4d-2ce3-462d-b488-5b5a3dac011a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1744 microversion: 2.20 time: 0.314891 Jun 30 10:45:17.946235 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 298/601] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:45:17 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1744 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:45:18.965528 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-bee0e9fb-c68c-4bde-a1bc-4cf82ccab8e4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:18.966201 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-bee0e9fb-c68c-4bde-a1bc-4cf82ccab8e4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:18.972527 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-bee0e9fb-c68c-4bde-a1bc-4cf82ccab8e4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:18.972985 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-bee0e9fb-c68c-4bde-a1bc-4cf82ccab8e4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:18.973732 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-bee0e9fb-c68c-4bde-a1bc-4cf82ccab8e4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:18.974159 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-bee0e9fb-c68c-4bde-a1bc-4cf82ccab8e4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:19.103138 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-bee0e9fb-c68c-4bde-a1bc-4cf82ccab8e4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:19.111514 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-bee0e9fb-c68c-4bde-a1bc-4cf82ccab8e4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:19.113018 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-bee0e9fb-c68c-4bde-a1bc-4cf82ccab8e4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:19.114156 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-bee0e9fb-c68c-4bde-a1bc-4cf82ccab8e4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1744 microversion: 2.20 time: 0.153354 Jun 30 10:45:19.114708 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 304/602] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:45:18 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:45:20.132629 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-5aab4ff3-71eb-4244-9dce-c2f2c3233eef tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:20.133228 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-5aab4ff3-71eb-4244-9dce-c2f2c3233eef tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:20.139607 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5aab4ff3-71eb-4244-9dce-c2f2c3233eef tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:20.140046 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5aab4ff3-71eb-4244-9dce-c2f2c3233eef tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:20.140822 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5aab4ff3-71eb-4244-9dce-c2f2c3233eef tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:20.141254 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5aab4ff3-71eb-4244-9dce-c2f2c3233eef tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:20.270739 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-5aab4ff3-71eb-4244-9dce-c2f2c3233eef tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:20.279041 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-5aab4ff3-71eb-4244-9dce-c2f2c3233eef tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:20.281422 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-5aab4ff3-71eb-4244-9dce-c2f2c3233eef tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:20.282576 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-5aab4ff3-71eb-4244-9dce-c2f2c3233eef tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1744 microversion: 2.20 time: 0.154003 Jun 30 10:45:20.283136 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 299/603] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:45:20 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:45:20.412412 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-2237aeaf-4b70-444f-b1c4-52145d3b4005 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:20.412922 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-2237aeaf-4b70-444f-b1c4-52145d3b4005 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:20.418865 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-2237aeaf-4b70-444f-b1c4-52145d3b4005 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:20.419309 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-2237aeaf-4b70-444f-b1c4-52145d3b4005 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:20.420105 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-2237aeaf-4b70-444f-b1c4-52145d3b4005 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:20.420560 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-2237aeaf-4b70-444f-b1c4-52145d3b4005 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:20.443612 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-2237aeaf-4b70-444f-b1c4-52145d3b4005 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725/ips" status: 200 len: 145 microversion: 2.1 time: 0.140751 Jun 30 10:45:20.444160 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 305/604] 10.222.0.59 () {58 vars in 1247 bytes} [Thu Jun 30 10:45:20 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725/ips => generated 145 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:45:21.142180 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-cbd1e287-ac7a-44be-9147-f10aac97b8c4 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:21.142692 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-cbd1e287-ac7a-44be-9147-f10aac97b8c4 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 6bc2024c-c05e-4409-a142-e8cf3191a203] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:21.148984 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-cbd1e287-ac7a-44be-9147-f10aac97b8c4 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:21.149638 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-cbd1e287-ac7a-44be-9147-f10aac97b8c4 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:21.150415 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-cbd1e287-ac7a-44be-9147-f10aac97b8c4 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:21.150854 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-cbd1e287-ac7a-44be-9147-f10aac97b8c4 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:21.183628 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-cbd1e287-ac7a-44be-9147-f10aac97b8c4 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203/ips" status: 200 len: 150 microversion: 2.1 time: 0.151507 Jun 30 10:45:21.184867 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 300/605] 10.222.0.59 () {58 vars in 1247 bytes} [Thu Jun 30 10:45:21 2022] GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203/ips => generated 150 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 10:45:21.302524 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-632d5e1c-ed63-42e8-9c2b-86e68e38d0b9 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:21.303138 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-632d5e1c-ed63-42e8-9c2b-86e68e38d0b9 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:21.310298 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-632d5e1c-ed63-42e8-9c2b-86e68e38d0b9 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:21.311177 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-632d5e1c-ed63-42e8-9c2b-86e68e38d0b9 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:21.312462 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-632d5e1c-ed63-42e8-9c2b-86e68e38d0b9 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:21.313172 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-632d5e1c-ed63-42e8-9c2b-86e68e38d0b9 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:21.478768 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-632d5e1c-ed63-42e8-9c2b-86e68e38d0b9 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:21.487098 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-632d5e1c-ed63-42e8-9c2b-86e68e38d0b9 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:21.491212 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-632d5e1c-ed63-42e8-9c2b-86e68e38d0b9 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:21.492390 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-632d5e1c-ed63-42e8-9c2b-86e68e38d0b9 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1739 microversion: 2.20 time: 0.194666 Jun 30 10:45:21.493149 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 306/606] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:45:21 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1739 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:45:22.512687 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-792bdc06-f19a-4111-98d1-e0e02d38f6e3 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:22.513236 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-792bdc06-f19a-4111-98d1-e0e02d38f6e3 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:22.531626 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-792bdc06-f19a-4111-98d1-e0e02d38f6e3 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:22.532154 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-792bdc06-f19a-4111-98d1-e0e02d38f6e3 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:22.533079 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-792bdc06-f19a-4111-98d1-e0e02d38f6e3 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:22.533448 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-792bdc06-f19a-4111-98d1-e0e02d38f6e3 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:22.690046 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-b36bd875-3374-4c04-865c-ee0e18319309 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5895ff83-fbfd-4109-8737-162608139595"}} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:45:22.691146 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-b36bd875-3374-4c04-865c-ee0e18319309 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 6bc2024c-c05e-4409-a142-e8cf3191a203] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:22.699773 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b36bd875-3374-4c04-865c-ee0e18319309 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:22.700233 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b36bd875-3374-4c04-865c-ee0e18319309 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:22.701030 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b36bd875-3374-4c04-865c-ee0e18319309 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:22.708789 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b36bd875-3374-4c04-865c-ee0e18319309 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:22.727485 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-792bdc06-f19a-4111-98d1-e0e02d38f6e3 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:22.743970 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-792bdc06-f19a-4111-98d1-e0e02d38f6e3 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:22.747476 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-792bdc06-f19a-4111-98d1-e0e02d38f6e3 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:22.748844 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-792bdc06-f19a-4111-98d1-e0e02d38f6e3 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1739 microversion: 2.20 time: 0.241399 Jun 30 10:45:22.750590 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 301/607] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:45:22 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1739 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 10:45:23.063538 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-b36bd875-3374-4c04-865c-ee0e18319309 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "POST /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.378050 Jun 30 10:45:23.064532 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 307/608] 10.222.0.59 () {60 vars in 1322 bytes} [Thu Jun 30 10:45:22 2022] POST /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203/os-volume_attachments => generated 194 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:45:23.767775 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-4fa400f2-a858-4a73-9133-c720c1bced06 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:23.768397 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-4fa400f2-a858-4a73-9133-c720c1bced06 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:23.775338 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-4fa400f2-a858-4a73-9133-c720c1bced06 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:23.775988 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-4fa400f2-a858-4a73-9133-c720c1bced06 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:23.776939 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-4fa400f2-a858-4a73-9133-c720c1bced06 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:23.777607 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-4fa400f2-a858-4a73-9133-c720c1bced06 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:23.830107 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-879c2a3a-a7ba-4ee4-b78f-dbbcbab15769 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cb618343-7cfc-44ea-b816-5de1f780f126"}} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:45:23.831483 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-879c2a3a-a7ba-4ee4-b78f-dbbcbab15769 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:23.838273 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-879c2a3a-a7ba-4ee4-b78f-dbbcbab15769 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:23.838727 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-879c2a3a-a7ba-4ee4-b78f-dbbcbab15769 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:23.839495 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-879c2a3a-a7ba-4ee4-b78f-dbbcbab15769 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:23.839936 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-879c2a3a-a7ba-4ee4-b78f-dbbcbab15769 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:23.937066 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-4fa400f2-a858-4a73-9133-c720c1bced06 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:23.945165 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-4fa400f2-a858-4a73-9133-c720c1bced06 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:23.946692 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-4fa400f2-a858-4a73-9133-c720c1bced06 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:23.947905 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-4fa400f2-a858-4a73-9133-c720c1bced06 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1739 microversion: 2.20 time: 0.184107 Jun 30 10:45:23.948732 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 302/609] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:45:23 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1739 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:45:24.097710 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-879c2a3a-a7ba-4ee4-b78f-dbbcbab15769 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "POST /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.271499 Jun 30 10:45:24.098709 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 308/610] 10.222.0.59 () {60 vars in 1322 bytes} [Thu Jun 30 10:45:23 2022] POST /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 10:45:24.966541 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-e5e9130e-37f4-459d-b138-f1996e5ffcf3 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:24.967662 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-e5e9130e-37f4-459d-b138-f1996e5ffcf3 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:24.975463 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-e5e9130e-37f4-459d-b138-f1996e5ffcf3 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:24.975902 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-e5e9130e-37f4-459d-b138-f1996e5ffcf3 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:24.976699 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-e5e9130e-37f4-459d-b138-f1996e5ffcf3 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:24.977136 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-e5e9130e-37f4-459d-b138-f1996e5ffcf3 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:25.125335 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-e5e9130e-37f4-459d-b138-f1996e5ffcf3 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:25.133385 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-e5e9130e-37f4-459d-b138-f1996e5ffcf3 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:25.134913 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-e5e9130e-37f4-459d-b138-f1996e5ffcf3 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:25.136141 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-e5e9130e-37f4-459d-b138-f1996e5ffcf3 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1739 microversion: 2.20 time: 0.173455 Jun 30 10:45:25.137106 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 303/611] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:45:24 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1739 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:45:26.160111 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-e6c746af-4d8d-49a2-81fb-e3f96260fc58 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:26.162200 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-e6c746af-4d8d-49a2-81fb-e3f96260fc58 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:26.173242 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e6c746af-4d8d-49a2-81fb-e3f96260fc58 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:26.173695 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e6c746af-4d8d-49a2-81fb-e3f96260fc58 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:26.174464 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e6c746af-4d8d-49a2-81fb-e3f96260fc58 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:26.174901 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e6c746af-4d8d-49a2-81fb-e3f96260fc58 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:26.336722 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-e6c746af-4d8d-49a2-81fb-e3f96260fc58 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:26.345632 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-e6c746af-4d8d-49a2-81fb-e3f96260fc58 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:26.347153 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-e6c746af-4d8d-49a2-81fb-e3f96260fc58 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:26.349859 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-e6c746af-4d8d-49a2-81fb-e3f96260fc58 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1739 microversion: 2.20 time: 0.194999 Jun 30 10:45:26.350425 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 309/612] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:45:26 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1739 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:45:27.370080 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-77a4c23d-d81c-4377-8cb2-cf96ce13aeeb tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:27.371277 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-77a4c23d-d81c-4377-8cb2-cf96ce13aeeb tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:27.379183 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-77a4c23d-d81c-4377-8cb2-cf96ce13aeeb tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:27.379789 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-77a4c23d-d81c-4377-8cb2-cf96ce13aeeb tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:27.380769 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-77a4c23d-d81c-4377-8cb2-cf96ce13aeeb tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:27.381440 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-77a4c23d-d81c-4377-8cb2-cf96ce13aeeb tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:27.544093 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-77a4c23d-d81c-4377-8cb2-cf96ce13aeeb tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:27.552652 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-77a4c23d-d81c-4377-8cb2-cf96ce13aeeb tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:27.554170 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-77a4c23d-d81c-4377-8cb2-cf96ce13aeeb tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:27.555480 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-77a4c23d-d81c-4377-8cb2-cf96ce13aeeb tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1739 microversion: 2.20 time: 0.190256 Jun 30 10:45:27.556363 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 304/613] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:45:27 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1739 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:45:28.575097 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-9fdef4fa-fcfc-4727-83ca-a6913b59996d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:28.577669 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-9fdef4fa-fcfc-4727-83ca-a6913b59996d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:28.587778 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-9fdef4fa-fcfc-4727-83ca-a6913b59996d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:28.588359 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-9fdef4fa-fcfc-4727-83ca-a6913b59996d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:28.589265 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-9fdef4fa-fcfc-4727-83ca-a6913b59996d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:28.589805 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-9fdef4fa-fcfc-4727-83ca-a6913b59996d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:28.728243 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-9fdef4fa-fcfc-4727-83ca-a6913b59996d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:28.737679 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-9fdef4fa-fcfc-4727-83ca-a6913b59996d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:28.739465 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-9fdef4fa-fcfc-4727-83ca-a6913b59996d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:28.740722 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-9fdef4fa-fcfc-4727-83ca-a6913b59996d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1739 microversion: 2.20 time: 0.169644 Jun 30 10:45:28.741277 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 310/614] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:45:28 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1739 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:45:29.759289 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-4ce9f2d2-0517-4280-93dc-758e9a7b3059 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:29.760010 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-4ce9f2d2-0517-4280-93dc-758e9a7b3059 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:29.767472 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-4ce9f2d2-0517-4280-93dc-758e9a7b3059 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:29.768195 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-4ce9f2d2-0517-4280-93dc-758e9a7b3059 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:29.769399 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-4ce9f2d2-0517-4280-93dc-758e9a7b3059 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:29.770086 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-4ce9f2d2-0517-4280-93dc-758e9a7b3059 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:29.945555 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-4ce9f2d2-0517-4280-93dc-758e9a7b3059 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:29.961727 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-4ce9f2d2-0517-4280-93dc-758e9a7b3059 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:29.963237 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-4ce9f2d2-0517-4280-93dc-758e9a7b3059 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:29.964409 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-4ce9f2d2-0517-4280-93dc-758e9a7b3059 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1739 microversion: 2.20 time: 0.209289 Jun 30 10:45:29.969291 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 305/615] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:45:29 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1739 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:45:30.675846 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-1931fc97-4d49-48e6-aa9e-ab0d4d6921c5 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Action: 'create', calling method: .version_select at 0x7f4dade44f70>, body: {"keypair": {"name": "tempest-keypair-1025014063", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOQdYO+P7W8+j/awnEqzHm62Q8doa4cvOxFbrkWVXdK/sBzK9aN4otsWpQapfWRvhv0foD45clKxYO+WW81OHmtSE2564qtRjVxIOSBJ1ZAJ+ykAAcsNV6BN3n+fFK68DQ=="}} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:45:30.692130 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.quota [None req-1931fc97-4d49-48e6-aa9e-ab0d4d6921c5 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Getting quotas for project 848d69e5041341488aafc3e6d26d491c. Resources: {'key_pairs'} {{(pid=124203) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 10:45:30.696134 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.quota [None req-1931fc97-4d49-48e6-aa9e-ab0d4d6921c5 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Getting quotas for user d6a194d68415422fbc6ca75a8dbccf22 and project 848d69e5041341488aafc3e6d26d491c. Resources: {'key_pairs'} {{(pid=124203) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 10:45:30.725530 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-1931fc97-4d49-48e6-aa9e-ab0d4d6921c5 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.053432 Jun 30 10:45:30.726140 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 311/616] 10.222.0.59 () {60 vars in 1158 bytes} [Thu Jun 30 10:45:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:45:30.983732 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-ce562f34-535c-458b-a654-2db949e0fb58 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:30.984433 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-ce562f34-535c-458b-a654-2db949e0fb58 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:30.992354 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ce562f34-535c-458b-a654-2db949e0fb58 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:30.993144 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ce562f34-535c-458b-a654-2db949e0fb58 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:30.993920 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ce562f34-535c-458b-a654-2db949e0fb58 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:30.994525 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ce562f34-535c-458b-a654-2db949e0fb58 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:31.165468 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-ce562f34-535c-458b-a654-2db949e0fb58 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:31.175481 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-ce562f34-535c-458b-a654-2db949e0fb58 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:31.177085 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-ce562f34-535c-458b-a654-2db949e0fb58 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:31.178265 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-ce562f34-535c-458b-a654-2db949e0fb58 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1739 microversion: 2.20 time: 0.198888 Jun 30 10:45:31.180541 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 306/617] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:45:30 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1739 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:45:32.197787 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-005f2d1f-5f0c-4216-b381-6f4b025d881f tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:32.198391 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-005f2d1f-5f0c-4216-b381-6f4b025d881f tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:32.204966 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-005f2d1f-5f0c-4216-b381-6f4b025d881f tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:32.205417 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-005f2d1f-5f0c-4216-b381-6f4b025d881f tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:32.206190 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-005f2d1f-5f0c-4216-b381-6f4b025d881f tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:32.206747 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-005f2d1f-5f0c-4216-b381-6f4b025d881f tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:32.251767 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-ee4870ce-b6cc-4eb0-9935-fa0412666fda tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-526365186", "imageRef": "c473bd04-5a45-4eb7-b6f4-2b5033d4fc1d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e1b0416a-2d8f-4305-a932-70d38f831d37"}], "security_groups": [{"name": "tempest-securitygroup--53346433"}], "key_name": "tempest-keypair-1025014063", "user_data": "}} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:45:32.369276 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-005f2d1f-5f0c-4216-b381-6f4b025d881f tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:32.377266 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-005f2d1f-5f0c-4216-b381-6f4b025d881f tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:32.378897 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.network.neutron [None req-ee4870ce-b6cc-4eb0-9935-fa0412666fda tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] validate_networks() for [('e1b0416a-2d8f-4305-a932-70d38f831d37', None, None, None, None, None)] {{(pid=124204) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 10:45:32.379126 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-005f2d1f-5f0c-4216-b381-6f4b025d881f tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:32.380288 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-005f2d1f-5f0c-4216-b381-6f4b025d881f tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1739 microversion: 2.20 time: 0.187016 Jun 30 10:45:32.380882 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 312/618] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:45:32 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1739 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:45:32.831095 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.virt.hardware [None req-ee4870ce-b6cc-4eb0-9935-fa0412666fda tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Flavor limits 0:0:0 {{(pid=124204) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 10:45:32.831524 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.virt.hardware [None req-ee4870ce-b6cc-4eb0-9935-fa0412666fda tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Image limits 0:0:0 {{(pid=124204) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 10:45:32.831999 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.virt.hardware [None req-ee4870ce-b6cc-4eb0-9935-fa0412666fda tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Flavor pref 0:0:0 {{(pid=124204) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 10:45:32.832408 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.virt.hardware [None req-ee4870ce-b6cc-4eb0-9935-fa0412666fda tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Image pref 0:0:0 {{(pid=124204) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 10:45:32.832847 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.virt.hardware [None req-ee4870ce-b6cc-4eb0-9935-fa0412666fda tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124204) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 10:45:32.842187 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ee4870ce-b6cc-4eb0-9935-fa0412666fda tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:32.842646 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ee4870ce-b6cc-4eb0-9935-fa0412666fda tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:32.843446 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ee4870ce-b6cc-4eb0-9935-fa0412666fda tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:32.843880 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ee4870ce-b6cc-4eb0-9935-fa0412666fda tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:32.860423 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.quota [None req-ee4870ce-b6cc-4eb0-9935-fa0412666fda tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Getting quotas for project 848d69e5041341488aafc3e6d26d491c. Resources: {'instances', 'cores', 'ram'} {{(pid=124204) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 10:45:32.864353 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.quota [None req-ee4870ce-b6cc-4eb0-9935-fa0412666fda tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Getting quotas for user d6a194d68415422fbc6ca75a8dbccf22 and project 848d69e5041341488aafc3e6d26d491c. Resources: {'instances', 'cores', 'ram'} {{(pid=124204) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 10:45:32.875255 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-ee4870ce-b6cc-4eb0-9935-fa0412666fda tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Going to run 1 instances... {{(pid=124204) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 10:45:32.877458 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-ee4870ce-b6cc-4eb0-9935-fa0412666fda tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: b4ed536b-47ac-4405-a11b-e2ed38021db3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c473bd04-5a45-4eb7-b6f4-2b5033d4fc1d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124204) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 10:45:32.923189 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-ee4870ce-b6cc-4eb0-9935-fa0412666fda tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.676959 Jun 30 10:45:32.923839 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 307/619] 10.222.0.59 () {60 vars in 1146 bytes} [Thu Jun 30 10:45:32 2022] POST /compute/v2.1/servers => generated 400 bytes in 678 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 30 10:45:32.933842 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-17e04c9e-9ec9-43ab-a507-55f3d4831001 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:32.934448 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-17e04c9e-9ec9-43ab-a507-55f3d4831001 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: b4ed536b-47ac-4405-a11b-e2ed38021db3] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:32.994386 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-17e04c9e-9ec9-43ab-a507-55f3d4831001 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:33.001285 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-17e04c9e-9ec9-43ab-a507-55f3d4831001 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/b4ed536b-47ac-4405-a11b-e2ed38021db3" status: 200 len: 1241 microversion: 2.1 time: 0.071331 Jun 30 10:45:33.002061 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 313/620] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:45:32 2022] GET /compute/v2.1/servers/b4ed536b-47ac-4405-a11b-e2ed38021db3 => generated 1241 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:45:33.398670 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-8a01cac1-0340-4406-b631-7332dda6e0b6 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:33.399282 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-8a01cac1-0340-4406-b631-7332dda6e0b6 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:33.405529 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-8a01cac1-0340-4406-b631-7332dda6e0b6 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:33.405972 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-8a01cac1-0340-4406-b631-7332dda6e0b6 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:33.406731 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-8a01cac1-0340-4406-b631-7332dda6e0b6 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:33.407166 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-8a01cac1-0340-4406-b631-7332dda6e0b6 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:33.549330 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-8a01cac1-0340-4406-b631-7332dda6e0b6 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:33.558464 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-8a01cac1-0340-4406-b631-7332dda6e0b6 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:33.559942 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-8a01cac1-0340-4406-b631-7332dda6e0b6 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:33.561801 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-8a01cac1-0340-4406-b631-7332dda6e0b6 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1721 microversion: 2.20 time: 0.167514 Jun 30 10:45:33.562370 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 308/621] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:45:33 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:45:34.019107 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-586e9bb1-372c-4e18-9c89-27eebcc2845f tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:34.019979 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-586e9bb1-372c-4e18-9c89-27eebcc2845f tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: b4ed536b-47ac-4405-a11b-e2ed38021db3] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:34.027085 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-586e9bb1-372c-4e18-9c89-27eebcc2845f tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:34.027587 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-586e9bb1-372c-4e18-9c89-27eebcc2845f tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:34.028526 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-586e9bb1-372c-4e18-9c89-27eebcc2845f tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:34.029079 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-586e9bb1-372c-4e18-9c89-27eebcc2845f tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:34.099869 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-586e9bb1-372c-4e18-9c89-27eebcc2845f tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:34.110354 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-586e9bb1-372c-4e18-9c89-27eebcc2845f tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/b4ed536b-47ac-4405-a11b-e2ed38021db3" status: 200 len: 1311 microversion: 2.1 time: 0.095058 Jun 30 10:45:34.111410 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 314/622] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:45:34 2022] GET /compute/v2.1/servers/b4ed536b-47ac-4405-a11b-e2ed38021db3 => generated 1311 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:45:34.585757 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-a87ea6e3-e9bc-48c3-918d-9fc4be31b3a0 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:34.586387 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-a87ea6e3-e9bc-48c3-918d-9fc4be31b3a0 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:34.593520 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a87ea6e3-e9bc-48c3-918d-9fc4be31b3a0 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:34.593957 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a87ea6e3-e9bc-48c3-918d-9fc4be31b3a0 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:34.594709 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a87ea6e3-e9bc-48c3-918d-9fc4be31b3a0 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:34.595143 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a87ea6e3-e9bc-48c3-918d-9fc4be31b3a0 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:34.723725 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-a87ea6e3-e9bc-48c3-918d-9fc4be31b3a0 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:34.731948 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-a87ea6e3-e9bc-48c3-918d-9fc4be31b3a0 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:34.734127 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-a87ea6e3-e9bc-48c3-918d-9fc4be31b3a0 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:34.735283 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-a87ea6e3-e9bc-48c3-918d-9fc4be31b3a0 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1721 microversion: 2.20 time: 0.153648 Jun 30 10:45:34.735834 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 309/623] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:45:34 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:45:35.127321 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-8bc17883-876a-4a77-bafe-3f725397c4cc tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:35.127924 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-8bc17883-876a-4a77-bafe-3f725397c4cc tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: b4ed536b-47ac-4405-a11b-e2ed38021db3] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:35.136173 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-8bc17883-876a-4a77-bafe-3f725397c4cc tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:35.136660 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-8bc17883-876a-4a77-bafe-3f725397c4cc tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:35.137467 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-8bc17883-876a-4a77-bafe-3f725397c4cc tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:35.137907 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-8bc17883-876a-4a77-bafe-3f725397c4cc tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:35.206842 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-8bc17883-876a-4a77-bafe-3f725397c4cc tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:35.214183 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-8bc17883-876a-4a77-bafe-3f725397c4cc tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/b4ed536b-47ac-4405-a11b-e2ed38021db3" status: 200 len: 1299 microversion: 2.1 time: 0.090913 Jun 30 10:45:35.214750 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 315/624] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:45:35 2022] GET /compute/v2.1/servers/b4ed536b-47ac-4405-a11b-e2ed38021db3 => generated 1299 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:45:35.753605 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-106400f7-e9ea-4bb9-9327-2298d751dd66 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:35.754211 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-106400f7-e9ea-4bb9-9327-2298d751dd66 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:35.760703 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-106400f7-e9ea-4bb9-9327-2298d751dd66 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:35.761148 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-106400f7-e9ea-4bb9-9327-2298d751dd66 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:35.761939 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-106400f7-e9ea-4bb9-9327-2298d751dd66 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:35.762368 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-106400f7-e9ea-4bb9-9327-2298d751dd66 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:35.888411 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-106400f7-e9ea-4bb9-9327-2298d751dd66 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:35.896239 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-106400f7-e9ea-4bb9-9327-2298d751dd66 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:35.897758 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-106400f7-e9ea-4bb9-9327-2298d751dd66 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:35.898915 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-106400f7-e9ea-4bb9-9327-2298d751dd66 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1721 microversion: 2.20 time: 0.149246 Jun 30 10:45:35.899471 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 310/625] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:45:35 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 10:45:36.231991 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-58c30441-1550-4de6-8fac-c258994027b8 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:36.233394 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-58c30441-1550-4de6-8fac-c258994027b8 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: b4ed536b-47ac-4405-a11b-e2ed38021db3] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:36.239997 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-58c30441-1550-4de6-8fac-c258994027b8 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:36.240532 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-58c30441-1550-4de6-8fac-c258994027b8 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:36.241380 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-58c30441-1550-4de6-8fac-c258994027b8 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:36.241876 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-58c30441-1550-4de6-8fac-c258994027b8 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:36.307270 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-58c30441-1550-4de6-8fac-c258994027b8 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:36.314724 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-58c30441-1550-4de6-8fac-c258994027b8 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/b4ed536b-47ac-4405-a11b-e2ed38021db3" status: 200 len: 1299 microversion: 2.1 time: 0.086891 Jun 30 10:45:36.315281 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 316/626] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:45:36 2022] GET /compute/v2.1/servers/b4ed536b-47ac-4405-a11b-e2ed38021db3 => generated 1299 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:45:36.916448 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-0b082d30-1c96-45bc-a6cd-052258599512 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:36.917075 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-0b082d30-1c96-45bc-a6cd-052258599512 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:36.925102 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-0b082d30-1c96-45bc-a6cd-052258599512 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:36.925102 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-0b082d30-1c96-45bc-a6cd-052258599512 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:36.925764 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-0b082d30-1c96-45bc-a6cd-052258599512 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:36.926190 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-0b082d30-1c96-45bc-a6cd-052258599512 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:37.108781 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-0b082d30-1c96-45bc-a6cd-052258599512 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:37.115754 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_cell1:SELECT=100 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:45:37.124185 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-0b082d30-1c96-45bc-a6cd-052258599512 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:37.126009 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-0b082d30-1c96-45bc-a6cd-052258599512 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:37.127388 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-0b082d30-1c96-45bc-a6cd-052258599512 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1724 microversion: 2.20 time: 0.214811 Jun 30 10:45:37.128456 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 311/627] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:45:36 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1724 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:45:37.147315 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-64c7acda-ae2f-44ce-ae8a-0bfdeee78928 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6c7f3b00-aa81-4315-9cc9-03fe78ce8ad9"}} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:45:37.149440 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-64c7acda-ae2f-44ce-ae8a-0bfdeee78928 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:37.160113 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-64c7acda-ae2f-44ce-ae8a-0bfdeee78928 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:37.160870 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-64c7acda-ae2f-44ce-ae8a-0bfdeee78928 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:37.162532 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-64c7acda-ae2f-44ce-ae8a-0bfdeee78928 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:37.163875 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-64c7acda-ae2f-44ce-ae8a-0bfdeee78928 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:37.277224 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [req-01735920-5b16-4efc-81d9-efa1541bcffc req-9cb07ead-1065-41d3-b0c1-779f3016164a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4ed536b-47ac-4405-a11b-e2ed38021db3", "tag": "650e7205-eab8-4f78-9a90-22d014fc7c86"}]} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:45:37.292394 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-01735920-5b16-4efc-81d9-efa1541bcffc req-9cb07ead-1065-41d3-b0c1-779f3016164a service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:37.292878 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-01735920-5b16-4efc-81d9-efa1541bcffc req-9cb07ead-1065-41d3-b0c1-779f3016164a service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:37.297227 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:45:37.316000 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.compute.server_external_events [req-01735920-5b16-4efc-81d9-efa1541bcffc req-9cb07ead-1065-41d3-b0c1-779f3016164a service nova] Creating event network-changed:650e7205-eab8-4f78-9a90-22d014fc7c86 for instance b4ed536b-47ac-4405-a11b-e2ed38021db3 on hv-cinder-82282 Jun 30 10:45:37.322446 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [req-01735920-5b16-4efc-81d9-efa1541bcffc req-9cb07ead-1065-41d3-b0c1-779f3016164a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.217920 Jun 30 10:45:37.323667 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 317/628] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:45:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 10:45:37.342780 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-6c8c550a-3acd-4e22-a74f-1d8d673ca1f7 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:37.345213 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-6c8c550a-3acd-4e22-a74f-1d8d673ca1f7 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: b4ed536b-47ac-4405-a11b-e2ed38021db3] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:37.363795 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-6c8c550a-3acd-4e22-a74f-1d8d673ca1f7 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:37.364578 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-6c8c550a-3acd-4e22-a74f-1d8d673ca1f7 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:37.365525 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-6c8c550a-3acd-4e22-a74f-1d8d673ca1f7 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:37.366101 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-6c8c550a-3acd-4e22-a74f-1d8d673ca1f7 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:37.549785 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-6c8c550a-3acd-4e22-a74f-1d8d673ca1f7 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:37.559421 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-6c8c550a-3acd-4e22-a74f-1d8d673ca1f7 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/b4ed536b-47ac-4405-a11b-e2ed38021db3" status: 200 len: 1365 microversion: 2.1 time: 0.229696 Jun 30 10:45:37.560928 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 318/629] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:45:37 2022] GET /compute/v2.1/servers/b4ed536b-47ac-4405-a11b-e2ed38021db3 => generated 1365 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:45:37.565315 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [req-ac4523fd-ce7c-4ab5-acac-0fd0ccf9d7d5 req-57b74f94-33f3-4d6d-82d8-cdc84cdafd52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af0d59b6-8e95-4947-803a-c1d952e218c8", "name": "network-vif-unplugged", "status": "completed", "tag": "ec009e37-3070-46e8-8a9a-513065a2c654"}]} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:45:37.573770 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-ac4523fd-ce7c-4ab5-acac-0fd0ccf9d7d5 req-57b74f94-33f3-4d6d-82d8-cdc84cdafd52 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:37.574212 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-ac4523fd-ce7c-4ab5-acac-0fd0ccf9d7d5 req-57b74f94-33f3-4d6d-82d8-cdc84cdafd52 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:37.590909 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.compute.server_external_events [req-ac4523fd-ce7c-4ab5-acac-0fd0ccf9d7d5 req-57b74f94-33f3-4d6d-82d8-cdc84cdafd52 service nova] Unable to find a host for instance af0d59b6-8e95-4947-803a-c1d952e218c8. Dropping event network-vif-unplugged {{(pid=124203) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 30 10:45:37.592626 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [req-ac4523fd-ce7c-4ab5-acac-0fd0ccf9d7d5 req-57b74f94-33f3-4d6d-82d8-cdc84cdafd52 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030859 Jun 30 10:45:37.593968 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 319/630] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:45:37 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 30 10:45:37.599920 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-64c7acda-ae2f-44ce-ae8a-0bfdeee78928 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "POST /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.457722 Jun 30 10:45:37.600995 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 312/631] 10.222.0.59 () {62 vars in 1363 bytes} [Thu Jun 30 10:45:37 2022] POST /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8/os-volume_attachments => generated 188 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 10:45:37.714055 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-045f9207-757a-4c46-9678-f956b0ab484b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:45:37.714615 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-045f9207-757a-4c46-9678-f956b0ab484b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:37.721119 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-045f9207-757a-4c46-9678-f956b0ab484b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:37.721566 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-045f9207-757a-4c46-9678-f956b0ab484b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:37.722324 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-045f9207-757a-4c46-9678-f956b0ab484b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:37.722755 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-045f9207-757a-4c46-9678-f956b0ab484b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:37.854630 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-045f9207-757a-4c46-9678-f956b0ab484b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "POST /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8/action" status: 202 len: 0 microversion: 2.20 time: 0.144272 Jun 30 10:45:37.858424 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 320/632] 10.222.0.59 () {62 vars in 1318 bytes} [Thu Jun 30 10:45:37 2022] POST /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 30 10:45:37.863566 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-12b872fc-df42-46c6-ad8c-908882cc86db tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:37.864188 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-12b872fc-df42-46c6-ad8c-908882cc86db tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:37.873570 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-12b872fc-df42-46c6-ad8c-908882cc86db tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:37.874020 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-12b872fc-df42-46c6-ad8c-908882cc86db tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:37.874791 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-12b872fc-df42-46c6-ad8c-908882cc86db tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:37.875231 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-12b872fc-df42-46c6-ad8c-908882cc86db tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:38.019163 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-50dd0c0b-d862-4414-ab01-7082ddb7de68 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:45:38.019434 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-12b872fc-df42-46c6-ad8c-908882cc86db tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:38.025907 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-50dd0c0b-d862-4414-ab01-7082ddb7de68 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:38.026364 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-50dd0c0b-d862-4414-ab01-7082ddb7de68 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:38.028571 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-12b872fc-df42-46c6-ad8c-908882cc86db tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:38.030152 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-12b872fc-df42-46c6-ad8c-908882cc86db tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:38.031415 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-12b872fc-df42-46c6-ad8c-908882cc86db tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1750 microversion: 2.20 time: 0.171735 Jun 30 10:45:38.032052 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 313/633] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:45:37 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1750 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:45:38.089396 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-50dd0c0b-d862-4414-ab01-7082ddb7de68 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Going to try to stop instance {{(pid=124203) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 30 10:45:38.135247 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-50dd0c0b-d862-4414-ab01-7082ddb7de68 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "POST /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725/action" status: 202 len: 0 microversion: 2.1 time: 0.121037 Jun 30 10:45:38.139143 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 321/634] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Jun 30 10:45:38 2022] POST /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 30 10:45:38.144076 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-ddbb5b8d-480a-4fad-9c83-f8892bb487e1 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:38.144730 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-ddbb5b8d-480a-4fad-9c83-f8892bb487e1 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:38.150933 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ddbb5b8d-480a-4fad-9c83-f8892bb487e1 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:38.151381 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ddbb5b8d-480a-4fad-9c83-f8892bb487e1 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:38.152146 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ddbb5b8d-480a-4fad-9c83-f8892bb487e1 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:38.152615 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ddbb5b8d-480a-4fad-9c83-f8892bb487e1 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:38.287333 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-ddbb5b8d-480a-4fad-9c83-f8892bb487e1 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:38.295326 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-ddbb5b8d-480a-4fad-9c83-f8892bb487e1 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1723 microversion: 2.1 time: 0.155050 Jun 30 10:45:38.295915 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 314/635] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:45:38 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:45:38.578742 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-f1b03f61-48ff-4cfb-b399-bbd7efd04b89 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:38.579561 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-f1b03f61-48ff-4cfb-b399-bbd7efd04b89 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: b4ed536b-47ac-4405-a11b-e2ed38021db3] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:38.586083 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-f1b03f61-48ff-4cfb-b399-bbd7efd04b89 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:38.586568 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-f1b03f61-48ff-4cfb-b399-bbd7efd04b89 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:38.587351 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-f1b03f61-48ff-4cfb-b399-bbd7efd04b89 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:38.587786 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-f1b03f61-48ff-4cfb-b399-bbd7efd04b89 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:38.723272 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-f1b03f61-48ff-4cfb-b399-bbd7efd04b89 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:38.730981 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-f1b03f61-48ff-4cfb-b399-bbd7efd04b89 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/b4ed536b-47ac-4405-a11b-e2ed38021db3" status: 200 len: 1365 microversion: 2.1 time: 0.157579 Jun 30 10:45:38.731812 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 322/636] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:45:38 2022] GET /compute/v2.1/servers/b4ed536b-47ac-4405-a11b-e2ed38021db3 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:45:39.050278 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-6a4e7ebe-7526-44a0-85fd-27ff9056bed1 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:39.050889 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-6a4e7ebe-7526-44a0-85fd-27ff9056bed1 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:39.057324 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6a4e7ebe-7526-44a0-85fd-27ff9056bed1 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:39.057776 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6a4e7ebe-7526-44a0-85fd-27ff9056bed1 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:39.058529 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6a4e7ebe-7526-44a0-85fd-27ff9056bed1 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:39.058959 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6a4e7ebe-7526-44a0-85fd-27ff9056bed1 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:39.190422 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-6a4e7ebe-7526-44a0-85fd-27ff9056bed1 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:39.198708 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-6a4e7ebe-7526-44a0-85fd-27ff9056bed1 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:39.200207 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-6a4e7ebe-7526-44a0-85fd-27ff9056bed1 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:39.201382 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-6a4e7ebe-7526-44a0-85fd-27ff9056bed1 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1750 microversion: 2.20 time: 0.155089 Jun 30 10:45:39.201940 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 315/637] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:45:39 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1750 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:45:39.312130 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-5904cc1c-54b7-4639-85c7-2d8e1f7a40d0 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:39.312707 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-5904cc1c-54b7-4639-85c7-2d8e1f7a40d0 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:39.318769 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-5904cc1c-54b7-4639-85c7-2d8e1f7a40d0 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:39.319218 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-5904cc1c-54b7-4639-85c7-2d8e1f7a40d0 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:39.319980 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-5904cc1c-54b7-4639-85c7-2d8e1f7a40d0 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:39.320419 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-5904cc1c-54b7-4639-85c7-2d8e1f7a40d0 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:39.447594 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-5904cc1c-54b7-4639-85c7-2d8e1f7a40d0 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:39.456057 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-5904cc1c-54b7-4639-85c7-2d8e1f7a40d0 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1723 microversion: 2.1 time: 0.147844 Jun 30 10:45:39.456638 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 323/638] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:45:39 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:45:39.748597 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-eb56ec64-048b-42ed-a37b-51392eb2abdf tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:39.749245 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-eb56ec64-048b-42ed-a37b-51392eb2abdf tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: b4ed536b-47ac-4405-a11b-e2ed38021db3] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:39.751063 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:45:39.756460 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-eb56ec64-048b-42ed-a37b-51392eb2abdf tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:39.756946 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-eb56ec64-048b-42ed-a37b-51392eb2abdf tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:39.757713 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-eb56ec64-048b-42ed-a37b-51392eb2abdf tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:39.758149 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-eb56ec64-048b-42ed-a37b-51392eb2abdf tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:39.883242 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-eb56ec64-048b-42ed-a37b-51392eb2abdf tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:39.891172 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-eb56ec64-048b-42ed-a37b-51392eb2abdf tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/b4ed536b-47ac-4405-a11b-e2ed38021db3" status: 200 len: 1365 microversion: 2.1 time: 0.146428 Jun 30 10:45:39.891757 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 316/639] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:45:39 2022] GET /compute/v2.1/servers/b4ed536b-47ac-4405-a11b-e2ed38021db3 => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:45:40.220139 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-b87b7912-fb77-42a8-b209-8dcab1fe309b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:40.220775 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-b87b7912-fb77-42a8-b209-8dcab1fe309b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:40.227256 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b87b7912-fb77-42a8-b209-8dcab1fe309b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:40.227706 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b87b7912-fb77-42a8-b209-8dcab1fe309b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:40.228461 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b87b7912-fb77-42a8-b209-8dcab1fe309b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:40.228924 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b87b7912-fb77-42a8-b209-8dcab1fe309b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:40.359175 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-b87b7912-fb77-42a8-b209-8dcab1fe309b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:40.367475 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-b87b7912-fb77-42a8-b209-8dcab1fe309b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:40.368991 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-b87b7912-fb77-42a8-b209-8dcab1fe309b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:40.370146 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-b87b7912-fb77-42a8-b209-8dcab1fe309b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1750 microversion: 2.20 time: 0.154466 Jun 30 10:45:40.370698 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 324/640] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:45:40 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1750 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:45:40.473667 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-1edf7cf6-9091-460d-8dce-7df4dfd5ead3 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:40.474190 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-1edf7cf6-9091-460d-8dce-7df4dfd5ead3 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:40.481339 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1edf7cf6-9091-460d-8dce-7df4dfd5ead3 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:40.482046 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1edf7cf6-9091-460d-8dce-7df4dfd5ead3 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:40.483069 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1edf7cf6-9091-460d-8dce-7df4dfd5ead3 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:40.483515 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1edf7cf6-9091-460d-8dce-7df4dfd5ead3 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:40.608897 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-1edf7cf6-9091-460d-8dce-7df4dfd5ead3 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:40.616747 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-1edf7cf6-9091-460d-8dce-7df4dfd5ead3 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1723 microversion: 2.1 time: 0.147083 Jun 30 10:45:40.617313 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 317/641] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:45:40 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:45:40.907292 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-7df8a896-c1d5-4aa3-9ebd-2bd9968bb280 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:40.907930 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-7df8a896-c1d5-4aa3-9ebd-2bd9968bb280 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: b4ed536b-47ac-4405-a11b-e2ed38021db3] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:40.910955 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=1 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:45:40.915604 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-7df8a896-c1d5-4aa3-9ebd-2bd9968bb280 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:40.916059 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-7df8a896-c1d5-4aa3-9ebd-2bd9968bb280 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:40.916838 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-7df8a896-c1d5-4aa3-9ebd-2bd9968bb280 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:40.917451 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-7df8a896-c1d5-4aa3-9ebd-2bd9968bb280 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:41.051659 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-7df8a896-c1d5-4aa3-9ebd-2bd9968bb280 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:41.061007 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-7df8a896-c1d5-4aa3-9ebd-2bd9968bb280 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/b4ed536b-47ac-4405-a11b-e2ed38021db3" status: 200 len: 1365 microversion: 2.1 time: 0.156949 Jun 30 10:45:41.061574 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 325/642] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:45:40 2022] GET /compute/v2.1/servers/b4ed536b-47ac-4405-a11b-e2ed38021db3 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:45:41.388170 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-f30a8f02-7b57-4191-bd4f-82ee202cbdf1 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:41.388822 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-f30a8f02-7b57-4191-bd4f-82ee202cbdf1 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:41.395009 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f30a8f02-7b57-4191-bd4f-82ee202cbdf1 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:41.395459 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f30a8f02-7b57-4191-bd4f-82ee202cbdf1 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:41.396227 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f30a8f02-7b57-4191-bd4f-82ee202cbdf1 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:41.396700 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f30a8f02-7b57-4191-bd4f-82ee202cbdf1 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:41.545525 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-f30a8f02-7b57-4191-bd4f-82ee202cbdf1 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:41.555343 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-f30a8f02-7b57-4191-bd4f-82ee202cbdf1 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:41.557522 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-f30a8f02-7b57-4191-bd4f-82ee202cbdf1 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:41.558687 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-f30a8f02-7b57-4191-bd4f-82ee202cbdf1 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1752 microversion: 2.20 time: 0.174476 Jun 30 10:45:41.559390 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 318/643] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:45:41 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1752 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:45:41.634761 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-ab54589e-1a44-4a61-a521-7ce480cbd2db tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:41.635521 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-ab54589e-1a44-4a61-a521-7ce480cbd2db tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:41.642766 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ab54589e-1a44-4a61-a521-7ce480cbd2db tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:41.643533 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ab54589e-1a44-4a61-a521-7ce480cbd2db tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:41.644309 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ab54589e-1a44-4a61-a521-7ce480cbd2db tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:41.644960 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ab54589e-1a44-4a61-a521-7ce480cbd2db tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:41.784305 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-ab54589e-1a44-4a61-a521-7ce480cbd2db tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:41.792386 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-ab54589e-1a44-4a61-a521-7ce480cbd2db tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1723 microversion: 2.1 time: 0.161863 Jun 30 10:45:41.792991 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 326/644] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:45:41 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:45:42.078149 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-43a4cc85-ca5e-43ec-85a1-9bff7e0992fb tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:42.078754 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-43a4cc85-ca5e-43ec-85a1-9bff7e0992fb tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: b4ed536b-47ac-4405-a11b-e2ed38021db3] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:42.085863 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-43a4cc85-ca5e-43ec-85a1-9bff7e0992fb tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:42.086310 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-43a4cc85-ca5e-43ec-85a1-9bff7e0992fb tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:42.087072 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-43a4cc85-ca5e-43ec-85a1-9bff7e0992fb tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:42.087678 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-43a4cc85-ca5e-43ec-85a1-9bff7e0992fb tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:42.233265 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-43a4cc85-ca5e-43ec-85a1-9bff7e0992fb tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:42.241451 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-43a4cc85-ca5e-43ec-85a1-9bff7e0992fb tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/b4ed536b-47ac-4405-a11b-e2ed38021db3" status: 200 len: 1365 microversion: 2.1 time: 0.167606 Jun 30 10:45:42.242048 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 319/645] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:45:42 2022] GET /compute/v2.1/servers/b4ed536b-47ac-4405-a11b-e2ed38021db3 => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:45:42.579006 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-cc883572-cffc-438c-9dcd-0f0498845a9b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:42.579612 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-cc883572-cffc-438c-9dcd-0f0498845a9b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:42.586030 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-cc883572-cffc-438c-9dcd-0f0498845a9b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:42.586480 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-cc883572-cffc-438c-9dcd-0f0498845a9b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:42.587242 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-cc883572-cffc-438c-9dcd-0f0498845a9b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:42.587681 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-cc883572-cffc-438c-9dcd-0f0498845a9b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:42.715558 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-cc883572-cffc-438c-9dcd-0f0498845a9b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:42.724039 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-cc883572-cffc-438c-9dcd-0f0498845a9b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:42.725594 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-cc883572-cffc-438c-9dcd-0f0498845a9b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:42.726745 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-cc883572-cffc-438c-9dcd-0f0498845a9b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1808 microversion: 2.20 time: 0.151718 Jun 30 10:45:42.727299 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 327/646] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:45:42 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:45:42.810119 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-1cf86fad-3da7-4e3b-b1c3-23bb85ad71c2 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:42.810809 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-1cf86fad-3da7-4e3b-b1c3-23bb85ad71c2 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:42.817352 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1cf86fad-3da7-4e3b-b1c3-23bb85ad71c2 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:42.817878 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1cf86fad-3da7-4e3b-b1c3-23bb85ad71c2 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:42.818680 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1cf86fad-3da7-4e3b-b1c3-23bb85ad71c2 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:42.819122 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1cf86fad-3da7-4e3b-b1c3-23bb85ad71c2 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:42.851569 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_cell0:SELECT=2 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:45:42.871076 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_cell0:SELECT=6 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:45:42.946076 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-1cf86fad-3da7-4e3b-b1c3-23bb85ad71c2 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:42.954031 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-1cf86fad-3da7-4e3b-b1c3-23bb85ad71c2 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1723 microversion: 2.1 time: 0.148343 Jun 30 10:45:42.954596 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 320/647] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:45:42 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:45:43.259727 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-88bcf07e-ade8-47e9-857e-87ab31c739f7 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:43.260350 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-88bcf07e-ade8-47e9-857e-87ab31c739f7 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: b4ed536b-47ac-4405-a11b-e2ed38021db3] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:43.262232 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_cell0:SELECT=6 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:45:43.268912 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-88bcf07e-ade8-47e9-857e-87ab31c739f7 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:43.269369 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-88bcf07e-ade8-47e9-857e-87ab31c739f7 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:43.270144 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-88bcf07e-ade8-47e9-857e-87ab31c739f7 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:43.270677 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-88bcf07e-ade8-47e9-857e-87ab31c739f7 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:43.442948 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-88bcf07e-ade8-47e9-857e-87ab31c739f7 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:43.456753 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-88bcf07e-ade8-47e9-857e-87ab31c739f7 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/b4ed536b-47ac-4405-a11b-e2ed38021db3" status: 200 len: 1365 microversion: 2.1 time: 0.196170 Jun 30 10:45:43.457398 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 328/648] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:45:43 2022] GET /compute/v2.1/servers/b4ed536b-47ac-4405-a11b-e2ed38021db3 => generated 1365 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:45:43.632226 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [req-da302c59-ba2b-4a94-b1df-c7ac5dff7092 req-f55ab941-aa49-4f9a-885b-2b197ff008cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4ed536b-47ac-4405-a11b-e2ed38021db3", "name": "network-vif-plugged", "status": "completed", "tag": "650e7205-eab8-4f78-9a90-22d014fc7c86"}]} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:45:43.640735 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-da302c59-ba2b-4a94-b1df-c7ac5dff7092 req-f55ab941-aa49-4f9a-885b-2b197ff008cf service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:43.641241 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-da302c59-ba2b-4a94-b1df-c7ac5dff7092 req-f55ab941-aa49-4f9a-885b-2b197ff008cf service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:43.655463 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.compute.server_external_events [req-da302c59-ba2b-4a94-b1df-c7ac5dff7092 req-f55ab941-aa49-4f9a-885b-2b197ff008cf service nova] Creating event network-vif-plugged:650e7205-eab8-4f78-9a90-22d014fc7c86 for instance b4ed536b-47ac-4405-a11b-e2ed38021db3 on hv-cinder-82282 Jun 30 10:45:43.661354 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [req-da302c59-ba2b-4a94-b1df-c7ac5dff7092 req-f55ab941-aa49-4f9a-885b-2b197ff008cf service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032869 Jun 30 10:45:43.662211 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 321/649] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:45:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 10:45:43.745763 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-e05c6d52-b981-456c-9ea3-0ec97be3e2d4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:43.746630 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-e05c6d52-b981-456c-9ea3-0ec97be3e2d4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:43.753815 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e05c6d52-b981-456c-9ea3-0ec97be3e2d4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:43.754388 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e05c6d52-b981-456c-9ea3-0ec97be3e2d4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:43.755262 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e05c6d52-b981-456c-9ea3-0ec97be3e2d4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:43.755935 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e05c6d52-b981-456c-9ea3-0ec97be3e2d4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:43.891956 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-e05c6d52-b981-456c-9ea3-0ec97be3e2d4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:43.902941 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-e05c6d52-b981-456c-9ea3-0ec97be3e2d4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:43.905662 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-e05c6d52-b981-456c-9ea3-0ec97be3e2d4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:43.907069 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-e05c6d52-b981-456c-9ea3-0ec97be3e2d4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1808 microversion: 2.20 time: 0.165259 Jun 30 10:45:43.907842 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 329/650] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:45:43 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:45:43.972250 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-d8ec81e3-5f89-4a38-bed0-1344269ff3f1 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:43.972995 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-d8ec81e3-5f89-4a38-bed0-1344269ff3f1 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:43.979649 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d8ec81e3-5f89-4a38-bed0-1344269ff3f1 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:43.980307 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d8ec81e3-5f89-4a38-bed0-1344269ff3f1 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:43.981277 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d8ec81e3-5f89-4a38-bed0-1344269ff3f1 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:43.982608 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d8ec81e3-5f89-4a38-bed0-1344269ff3f1 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:44.119007 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-d8ec81e3-5f89-4a38-bed0-1344269ff3f1 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:44.127930 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-d8ec81e3-5f89-4a38-bed0-1344269ff3f1 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1723 microversion: 2.1 time: 0.160385 Jun 30 10:45:44.128530 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 322/651] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:45:43 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:45:44.474907 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-328934e2-afde-42d8-be21-39a74327a0f6 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:44.475517 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-328934e2-afde-42d8-be21-39a74327a0f6 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: b4ed536b-47ac-4405-a11b-e2ed38021db3] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:44.481942 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-328934e2-afde-42d8-be21-39a74327a0f6 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:44.482904 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-328934e2-afde-42d8-be21-39a74327a0f6 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:44.483700 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-328934e2-afde-42d8-be21-39a74327a0f6 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:44.484139 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-328934e2-afde-42d8-be21-39a74327a0f6 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:44.625938 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-328934e2-afde-42d8-be21-39a74327a0f6 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:44.633922 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-328934e2-afde-42d8-be21-39a74327a0f6 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/b4ed536b-47ac-4405-a11b-e2ed38021db3" status: 200 len: 1365 microversion: 2.1 time: 0.162806 Jun 30 10:45:44.634662 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 330/652] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:45:44 2022] GET /compute/v2.1/servers/b4ed536b-47ac-4405-a11b-e2ed38021db3 => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:45:44.925618 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-036a8962-d243-4c1b-b287-a3cfecf5dc46 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:44.926229 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-036a8962-d243-4c1b-b287-a3cfecf5dc46 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:44.932228 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-036a8962-d243-4c1b-b287-a3cfecf5dc46 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:44.932728 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-036a8962-d243-4c1b-b287-a3cfecf5dc46 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:44.933489 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-036a8962-d243-4c1b-b287-a3cfecf5dc46 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:44.933943 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-036a8962-d243-4c1b-b287-a3cfecf5dc46 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:45.071083 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-036a8962-d243-4c1b-b287-a3cfecf5dc46 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:45.080329 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-036a8962-d243-4c1b-b287-a3cfecf5dc46 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:45.082110 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-036a8962-d243-4c1b-b287-a3cfecf5dc46 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:45.083269 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-036a8962-d243-4c1b-b287-a3cfecf5dc46 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1808 microversion: 2.20 time: 0.161550 Jun 30 10:45:45.083824 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 323/653] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:45:44 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:45:45.145485 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-b04d4c5d-e332-4d13-a544-5e45f6af493c tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:45.146024 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-b04d4c5d-e332-4d13-a544-5e45f6af493c tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:45.152640 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b04d4c5d-e332-4d13-a544-5e45f6af493c tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:45.153087 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b04d4c5d-e332-4d13-a544-5e45f6af493c tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:45.153846 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b04d4c5d-e332-4d13-a544-5e45f6af493c tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:45.154285 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b04d4c5d-e332-4d13-a544-5e45f6af493c tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:45.290673 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-b04d4c5d-e332-4d13-a544-5e45f6af493c tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:45.299104 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-b04d4c5d-e332-4d13-a544-5e45f6af493c tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1723 microversion: 2.1 time: 0.157480 Jun 30 10:45:45.300130 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 331/654] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:45:45 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:45:45.651253 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-ca141e0a-c505-4ead-8d01-82c668440b53 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:45.651887 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-ca141e0a-c505-4ead-8d01-82c668440b53 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: b4ed536b-47ac-4405-a11b-e2ed38021db3] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:45.658117 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ca141e0a-c505-4ead-8d01-82c668440b53 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:45.658556 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ca141e0a-c505-4ead-8d01-82c668440b53 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:45.659310 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ca141e0a-c505-4ead-8d01-82c668440b53 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:45.659743 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ca141e0a-c505-4ead-8d01-82c668440b53 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:45.788218 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-ca141e0a-c505-4ead-8d01-82c668440b53 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:45.796955 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-ca141e0a-c505-4ead-8d01-82c668440b53 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/b4ed536b-47ac-4405-a11b-e2ed38021db3" status: 200 len: 1365 microversion: 2.1 time: 0.149455 Jun 30 10:45:45.799464 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 324/655] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:45:45 2022] GET /compute/v2.1/servers/b4ed536b-47ac-4405-a11b-e2ed38021db3 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:45:46.101539 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-1f22f6aa-862e-4206-828a-0c060d8ad320 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:46.102264 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-1f22f6aa-862e-4206-828a-0c060d8ad320 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:46.109770 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-1f22f6aa-862e-4206-828a-0c060d8ad320 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:46.110287 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-1f22f6aa-862e-4206-828a-0c060d8ad320 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:46.111002 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-1f22f6aa-862e-4206-828a-0c060d8ad320 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:46.111448 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-1f22f6aa-862e-4206-828a-0c060d8ad320 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:46.253024 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-1f22f6aa-862e-4206-828a-0c060d8ad320 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:46.263916 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-1f22f6aa-862e-4206-828a-0c060d8ad320 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:46.266799 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-1f22f6aa-862e-4206-828a-0c060d8ad320 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:46.268304 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-1f22f6aa-862e-4206-828a-0c060d8ad320 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1808 microversion: 2.20 time: 0.170587 Jun 30 10:45:46.268886 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 332/656] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:45:46 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:45:46.317497 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-8400ca04-caee-440c-a244-b58a47148b26 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:46.318144 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-8400ca04-caee-440c-a244-b58a47148b26 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:46.325152 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-8400ca04-caee-440c-a244-b58a47148b26 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:46.326350 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-8400ca04-caee-440c-a244-b58a47148b26 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:46.327296 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-8400ca04-caee-440c-a244-b58a47148b26 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:46.327920 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-8400ca04-caee-440c-a244-b58a47148b26 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:46.461365 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-8400ca04-caee-440c-a244-b58a47148b26 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:46.470085 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-8400ca04-caee-440c-a244-b58a47148b26 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1723 microversion: 2.1 time: 0.156844 Jun 30 10:45:46.470874 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 325/657] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:45:46 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:45:46.814562 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-afeb720b-2f5d-490f-be6f-a33f8f7ae9b4 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:46.815083 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-afeb720b-2f5d-490f-be6f-a33f8f7ae9b4 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: b4ed536b-47ac-4405-a11b-e2ed38021db3] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:46.821068 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-afeb720b-2f5d-490f-be6f-a33f8f7ae9b4 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:46.821512 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-afeb720b-2f5d-490f-be6f-a33f8f7ae9b4 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:46.822277 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-afeb720b-2f5d-490f-be6f-a33f8f7ae9b4 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:46.822709 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-afeb720b-2f5d-490f-be6f-a33f8f7ae9b4 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:46.825246 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:45:46.963461 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-afeb720b-2f5d-490f-be6f-a33f8f7ae9b4 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:46.971249 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-afeb720b-2f5d-490f-be6f-a33f8f7ae9b4 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/b4ed536b-47ac-4405-a11b-e2ed38021db3" status: 200 len: 1365 microversion: 2.1 time: 0.161107 Jun 30 10:45:46.972116 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 333/658] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:45:46 2022] GET /compute/v2.1/servers/b4ed536b-47ac-4405-a11b-e2ed38021db3 => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:45:47.287761 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-0da678c0-de13-46a6-937f-18b89bee758c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:47.288361 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-0da678c0-de13-46a6-937f-18b89bee758c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:47.294477 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-0da678c0-de13-46a6-937f-18b89bee758c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:47.295592 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-0da678c0-de13-46a6-937f-18b89bee758c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:47.296351 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-0da678c0-de13-46a6-937f-18b89bee758c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:47.296813 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-0da678c0-de13-46a6-937f-18b89bee758c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:47.313044 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:45:47.435216 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-0da678c0-de13-46a6-937f-18b89bee758c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:47.443875 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-0da678c0-de13-46a6-937f-18b89bee758c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:47.445467 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-0da678c0-de13-46a6-937f-18b89bee758c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:47.446636 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-0da678c0-de13-46a6-937f-18b89bee758c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1808 microversion: 2.20 time: 0.163192 Jun 30 10:45:47.447192 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 326/659] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:45:47 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 10:45:47.488590 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-504f3f99-9364-43d5-9231-8af2bc778613 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:47.489397 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-504f3f99-9364-43d5-9231-8af2bc778613 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:47.496020 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-504f3f99-9364-43d5-9231-8af2bc778613 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:47.496527 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-504f3f99-9364-43d5-9231-8af2bc778613 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:47.497306 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-504f3f99-9364-43d5-9231-8af2bc778613 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:47.497743 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-504f3f99-9364-43d5-9231-8af2bc778613 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:47.634223 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-504f3f99-9364-43d5-9231-8af2bc778613 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:47.643005 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-504f3f99-9364-43d5-9231-8af2bc778613 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1723 microversion: 2.1 time: 0.158517 Jun 30 10:45:47.644776 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 334/660] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:45:47 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:45:47.988598 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-81f013da-a20e-4c9f-a4ef-6b9d84c86378 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:47.989213 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-81f013da-a20e-4c9f-a4ef-6b9d84c86378 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: b4ed536b-47ac-4405-a11b-e2ed38021db3] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:47.995397 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-81f013da-a20e-4c9f-a4ef-6b9d84c86378 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:47.995837 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-81f013da-a20e-4c9f-a4ef-6b9d84c86378 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:47.996615 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-81f013da-a20e-4c9f-a4ef-6b9d84c86378 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:47.997048 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-81f013da-a20e-4c9f-a4ef-6b9d84c86378 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:48.130691 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-81f013da-a20e-4c9f-a4ef-6b9d84c86378 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:48.138233 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-81f013da-a20e-4c9f-a4ef-6b9d84c86378 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/b4ed536b-47ac-4405-a11b-e2ed38021db3" status: 200 len: 1365 microversion: 2.1 time: 0.153444 Jun 30 10:45:48.138807 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 327/661] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:45:47 2022] GET /compute/v2.1/servers/b4ed536b-47ac-4405-a11b-e2ed38021db3 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:45:48.464798 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-fa84442b-df83-469e-98ea-4ecd845296ec tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:48.465403 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-fa84442b-df83-469e-98ea-4ecd845296ec tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:48.471529 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-fa84442b-df83-469e-98ea-4ecd845296ec tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:48.471970 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-fa84442b-df83-469e-98ea-4ecd845296ec tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:48.472760 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-fa84442b-df83-469e-98ea-4ecd845296ec tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:48.473190 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-fa84442b-df83-469e-98ea-4ecd845296ec tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:48.606091 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-fa84442b-df83-469e-98ea-4ecd845296ec tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:48.615787 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-fa84442b-df83-469e-98ea-4ecd845296ec tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:48.617592 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-fa84442b-df83-469e-98ea-4ecd845296ec tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:48.618975 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-fa84442b-df83-469e-98ea-4ecd845296ec tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1808 microversion: 2.20 time: 0.158151 Jun 30 10:45:48.619617 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 335/662] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:45:48 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:45:48.659482 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-a6e3cf89-8440-4d61-af2c-0e838918b786 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:48.660122 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-a6e3cf89-8440-4d61-af2c-0e838918b786 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:48.666988 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a6e3cf89-8440-4d61-af2c-0e838918b786 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:48.667517 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a6e3cf89-8440-4d61-af2c-0e838918b786 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:48.668375 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a6e3cf89-8440-4d61-af2c-0e838918b786 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:48.668902 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a6e3cf89-8440-4d61-af2c-0e838918b786 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:48.809570 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-a6e3cf89-8440-4d61-af2c-0e838918b786 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:48.817858 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-a6e3cf89-8440-4d61-af2c-0e838918b786 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1723 microversion: 2.1 time: 0.162208 Jun 30 10:45:48.818431 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 328/663] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:45:48 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:45:49.157908 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-d387e0fb-6680-4e87-bdd8-7ef609fbfac0 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:49.159043 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-d387e0fb-6680-4e87-bdd8-7ef609fbfac0 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: b4ed536b-47ac-4405-a11b-e2ed38021db3] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:49.166289 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-d387e0fb-6680-4e87-bdd8-7ef609fbfac0 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:49.166831 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-d387e0fb-6680-4e87-bdd8-7ef609fbfac0 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:49.167625 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-d387e0fb-6680-4e87-bdd8-7ef609fbfac0 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:49.168067 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-d387e0fb-6680-4e87-bdd8-7ef609fbfac0 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:49.317512 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-d387e0fb-6680-4e87-bdd8-7ef609fbfac0 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:49.325263 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-d387e0fb-6680-4e87-bdd8-7ef609fbfac0 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/b4ed536b-47ac-4405-a11b-e2ed38021db3" status: 200 len: 1365 microversion: 2.1 time: 0.172334 Jun 30 10:45:49.325972 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 336/664] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:45:49 2022] GET /compute/v2.1/servers/b4ed536b-47ac-4405-a11b-e2ed38021db3 => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:45:49.638369 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-7ced33bd-7df1-496d-abae-40cd48765742 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:49.638979 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-7ced33bd-7df1-496d-abae-40cd48765742 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:49.646133 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-7ced33bd-7df1-496d-abae-40cd48765742 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:49.646574 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-7ced33bd-7df1-496d-abae-40cd48765742 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:49.647479 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-7ced33bd-7df1-496d-abae-40cd48765742 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:49.647909 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-7ced33bd-7df1-496d-abae-40cd48765742 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:49.790844 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-7ced33bd-7df1-496d-abae-40cd48765742 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:49.799642 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-7ced33bd-7df1-496d-abae-40cd48765742 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:49.801208 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-7ced33bd-7df1-496d-abae-40cd48765742 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:49.802379 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-7ced33bd-7df1-496d-abae-40cd48765742 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1808 microversion: 2.20 time: 0.167894 Jun 30 10:45:49.802939 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 329/665] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:45:49 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:45:49.834676 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-9b0c5037-7e58-4e24-9b36-300fc212d616 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:49.835273 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-9b0c5037-7e58-4e24-9b36-300fc212d616 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:49.841779 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-9b0c5037-7e58-4e24-9b36-300fc212d616 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:49.842229 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-9b0c5037-7e58-4e24-9b36-300fc212d616 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:49.842984 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-9b0c5037-7e58-4e24-9b36-300fc212d616 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:49.843414 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-9b0c5037-7e58-4e24-9b36-300fc212d616 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:50.161400 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-9b0c5037-7e58-4e24-9b36-300fc212d616 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:50.169659 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-9b0c5037-7e58-4e24-9b36-300fc212d616 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1723 microversion: 2.1 time: 0.338796 Jun 30 10:45:50.170238 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 337/666] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:45:49 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1723 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:45:50.343618 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-bef427d2-3a50-49ac-992e-e55924a905c8 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:50.344220 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-bef427d2-3a50-49ac-992e-e55924a905c8 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: b4ed536b-47ac-4405-a11b-e2ed38021db3] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:50.350317 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-bef427d2-3a50-49ac-992e-e55924a905c8 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:50.350760 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-bef427d2-3a50-49ac-992e-e55924a905c8 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:50.351517 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-bef427d2-3a50-49ac-992e-e55924a905c8 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:50.351946 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-bef427d2-3a50-49ac-992e-e55924a905c8 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:50.488419 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-bef427d2-3a50-49ac-992e-e55924a905c8 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:50.496732 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-bef427d2-3a50-49ac-992e-e55924a905c8 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/b4ed536b-47ac-4405-a11b-e2ed38021db3" status: 200 len: 1365 microversion: 2.1 time: 0.157752 Jun 30 10:45:50.497580 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 330/667] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:45:50 2022] GET /compute/v2.1/servers/b4ed536b-47ac-4405-a11b-e2ed38021db3 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:45:50.825434 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-43a82103-b391-4a83-aefb-4464a6989692 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:50.826355 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-43a82103-b391-4a83-aefb-4464a6989692 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:50.835081 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-43a82103-b391-4a83-aefb-4464a6989692 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:50.835708 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-43a82103-b391-4a83-aefb-4464a6989692 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:50.836290 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-43a82103-b391-4a83-aefb-4464a6989692 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:50.836758 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-43a82103-b391-4a83-aefb-4464a6989692 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:50.973021 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-43a82103-b391-4a83-aefb-4464a6989692 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:50.981296 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-43a82103-b391-4a83-aefb-4464a6989692 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:50.983044 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-43a82103-b391-4a83-aefb-4464a6989692 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:50.984764 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-43a82103-b391-4a83-aefb-4464a6989692 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1808 microversion: 2.20 time: 0.166560 Jun 30 10:45:50.985318 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 338/668] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:45:50 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:45:51.187441 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-5b7e1eba-7f35-4dac-a740-e97cb6f85555 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:51.188085 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-5b7e1eba-7f35-4dac-a740-e97cb6f85555 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:51.194525 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5b7e1eba-7f35-4dac-a740-e97cb6f85555 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:51.194984 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5b7e1eba-7f35-4dac-a740-e97cb6f85555 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:51.195819 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5b7e1eba-7f35-4dac-a740-e97cb6f85555 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:51.196255 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5b7e1eba-7f35-4dac-a740-e97cb6f85555 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:51.335420 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-5b7e1eba-7f35-4dac-a740-e97cb6f85555 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:51.343437 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-5b7e1eba-7f35-4dac-a740-e97cb6f85555 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1723 microversion: 2.1 time: 0.159924 Jun 30 10:45:51.344002 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 331/669] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:45:51 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:45:51.514194 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-2305b370-4486-444e-8fbd-02448df7ca18 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:51.514801 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-2305b370-4486-444e-8fbd-02448df7ca18 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: b4ed536b-47ac-4405-a11b-e2ed38021db3] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:51.521281 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-2305b370-4486-444e-8fbd-02448df7ca18 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:51.521736 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-2305b370-4486-444e-8fbd-02448df7ca18 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:51.522511 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-2305b370-4486-444e-8fbd-02448df7ca18 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:51.523145 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-2305b370-4486-444e-8fbd-02448df7ca18 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:51.661958 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-2305b370-4486-444e-8fbd-02448df7ca18 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:51.669997 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-2305b370-4486-444e-8fbd-02448df7ca18 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/b4ed536b-47ac-4405-a11b-e2ed38021db3" status: 200 len: 1365 microversion: 2.1 time: 0.159610 Jun 30 10:45:51.670561 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 339/670] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:45:51 2022] GET /compute/v2.1/servers/b4ed536b-47ac-4405-a11b-e2ed38021db3 => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:45:52.003119 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-aa81e828-ef36-47ea-b4d9-be2df645679a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:52.003863 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-aa81e828-ef36-47ea-b4d9-be2df645679a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:52.010789 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-aa81e828-ef36-47ea-b4d9-be2df645679a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:52.011320 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-aa81e828-ef36-47ea-b4d9-be2df645679a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:52.012174 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-aa81e828-ef36-47ea-b4d9-be2df645679a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:52.012716 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-aa81e828-ef36-47ea-b4d9-be2df645679a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:52.156967 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-aa81e828-ef36-47ea-b4d9-be2df645679a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:52.165600 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-aa81e828-ef36-47ea-b4d9-be2df645679a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:52.167085 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-aa81e828-ef36-47ea-b4d9-be2df645679a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:52.168261 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-aa81e828-ef36-47ea-b4d9-be2df645679a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1808 microversion: 2.20 time: 0.169238 Jun 30 10:45:52.168858 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 332/671] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:45:51 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 10:45:52.361375 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-e8711b6e-b928-4eb3-bbc9-f2c2e53c38fb tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:52.362271 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-e8711b6e-b928-4eb3-bbc9-f2c2e53c38fb tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:52.369193 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e8711b6e-b928-4eb3-bbc9-f2c2e53c38fb tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:52.369642 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e8711b6e-b928-4eb3-bbc9-f2c2e53c38fb tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:52.370415 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e8711b6e-b928-4eb3-bbc9-f2c2e53c38fb tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:52.370847 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e8711b6e-b928-4eb3-bbc9-f2c2e53c38fb tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:52.507093 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-e8711b6e-b928-4eb3-bbc9-f2c2e53c38fb tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:52.516774 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-e8711b6e-b928-4eb3-bbc9-f2c2e53c38fb tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1723 microversion: 2.1 time: 0.159757 Jun 30 10:45:52.517286 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 340/672] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:45:52 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:45:52.687985 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-74a6673f-8111-4885-a08a-57c7acbf6079 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:52.689339 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-74a6673f-8111-4885-a08a-57c7acbf6079 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: b4ed536b-47ac-4405-a11b-e2ed38021db3] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:52.695503 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-74a6673f-8111-4885-a08a-57c7acbf6079 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:52.695955 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-74a6673f-8111-4885-a08a-57c7acbf6079 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:52.696754 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-74a6673f-8111-4885-a08a-57c7acbf6079 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:52.697229 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-74a6673f-8111-4885-a08a-57c7acbf6079 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:52.835328 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-74a6673f-8111-4885-a08a-57c7acbf6079 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:52.843442 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-74a6673f-8111-4885-a08a-57c7acbf6079 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/b4ed536b-47ac-4405-a11b-e2ed38021db3" status: 200 len: 1365 microversion: 2.1 time: 0.159479 Jun 30 10:45:52.844013 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 333/673] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:45:52 2022] GET /compute/v2.1/servers/b4ed536b-47ac-4405-a11b-e2ed38021db3 => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:45:53.187131 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-2b50dee4-f40b-4c22-b25e-27857ce66469 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:53.187740 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-2b50dee4-f40b-4c22-b25e-27857ce66469 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:53.194138 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-2b50dee4-f40b-4c22-b25e-27857ce66469 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:53.194587 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-2b50dee4-f40b-4c22-b25e-27857ce66469 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:53.195359 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-2b50dee4-f40b-4c22-b25e-27857ce66469 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:53.195793 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-2b50dee4-f40b-4c22-b25e-27857ce66469 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:53.334951 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-2b50dee4-f40b-4c22-b25e-27857ce66469 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:53.343876 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-2b50dee4-f40b-4c22-b25e-27857ce66469 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:53.345474 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-2b50dee4-f40b-4c22-b25e-27857ce66469 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:53.346724 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-2b50dee4-f40b-4c22-b25e-27857ce66469 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1808 microversion: 2.20 time: 0.164213 Jun 30 10:45:53.347383 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 341/674] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:45:53 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:45:53.534429 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-9be1b290-d40e-4c8e-b0e7-eca9c797c0d8 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:53.535144 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-9be1b290-d40e-4c8e-b0e7-eca9c797c0d8 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:53.541701 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-9be1b290-d40e-4c8e-b0e7-eca9c797c0d8 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:53.542140 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-9be1b290-d40e-4c8e-b0e7-eca9c797c0d8 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:53.542894 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-9be1b290-d40e-4c8e-b0e7-eca9c797c0d8 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:53.543325 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-9be1b290-d40e-4c8e-b0e7-eca9c797c0d8 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:53.677965 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-9be1b290-d40e-4c8e-b0e7-eca9c797c0d8 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:53.685877 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-9be1b290-d40e-4c8e-b0e7-eca9c797c0d8 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1723 microversion: 2.1 time: 0.155820 Jun 30 10:45:53.686464 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 334/675] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:45:53 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:45:53.860742 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-304704ec-352f-4b85-be79-8ed5855e8a4b tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:53.861347 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-304704ec-352f-4b85-be79-8ed5855e8a4b tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: b4ed536b-47ac-4405-a11b-e2ed38021db3] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:53.867715 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-304704ec-352f-4b85-be79-8ed5855e8a4b tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:53.868157 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-304704ec-352f-4b85-be79-8ed5855e8a4b tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:53.868938 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-304704ec-352f-4b85-be79-8ed5855e8a4b tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:53.869367 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-304704ec-352f-4b85-be79-8ed5855e8a4b tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:53.994649 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-304704ec-352f-4b85-be79-8ed5855e8a4b tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:54.002451 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-304704ec-352f-4b85-be79-8ed5855e8a4b tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/b4ed536b-47ac-4405-a11b-e2ed38021db3" status: 200 len: 1365 microversion: 2.1 time: 0.145856 Jun 30 10:45:54.003006 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 342/676] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:45:53 2022] GET /compute/v2.1/servers/b4ed536b-47ac-4405-a11b-e2ed38021db3 => generated 1365 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:45:54.365354 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-9ec148af-6e79-4797-be04-a4d40d1c99e9 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:54.365967 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-9ec148af-6e79-4797-be04-a4d40d1c99e9 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:54.371985 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-9ec148af-6e79-4797-be04-a4d40d1c99e9 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:54.372432 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-9ec148af-6e79-4797-be04-a4d40d1c99e9 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:54.373245 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-9ec148af-6e79-4797-be04-a4d40d1c99e9 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:54.374521 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-9ec148af-6e79-4797-be04-a4d40d1c99e9 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:54.500980 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-9ec148af-6e79-4797-be04-a4d40d1c99e9 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:54.509422 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-9ec148af-6e79-4797-be04-a4d40d1c99e9 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:54.510865 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-9ec148af-6e79-4797-be04-a4d40d1c99e9 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:54.512104 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-9ec148af-6e79-4797-be04-a4d40d1c99e9 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1808 microversion: 2.20 time: 0.150621 Jun 30 10:45:54.512673 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 335/677] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:45:54 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:45:54.703141 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-6242b966-7483-4db8-bc87-722a7a937afa tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:54.703842 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-6242b966-7483-4db8-bc87-722a7a937afa tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:54.709953 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-6242b966-7483-4db8-bc87-722a7a937afa tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:54.710403 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-6242b966-7483-4db8-bc87-722a7a937afa tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:54.711166 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-6242b966-7483-4db8-bc87-722a7a937afa tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:54.711602 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-6242b966-7483-4db8-bc87-722a7a937afa tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:54.851451 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-6242b966-7483-4db8-bc87-722a7a937afa tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:54.860261 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-6242b966-7483-4db8-bc87-722a7a937afa tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1723 microversion: 2.1 time: 0.161019 Jun 30 10:45:54.860846 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 343/678] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:45:54 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:45:55.019138 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-7af62741-50b7-4b6b-94b0-677d0e4cdb53 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:55.019754 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-7af62741-50b7-4b6b-94b0-677d0e4cdb53 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: b4ed536b-47ac-4405-a11b-e2ed38021db3] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:55.026271 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-7af62741-50b7-4b6b-94b0-677d0e4cdb53 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:55.026717 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-7af62741-50b7-4b6b-94b0-677d0e4cdb53 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:55.027480 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-7af62741-50b7-4b6b-94b0-677d0e4cdb53 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:55.027912 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-7af62741-50b7-4b6b-94b0-677d0e4cdb53 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:55.159863 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-7af62741-50b7-4b6b-94b0-677d0e4cdb53 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:55.167278 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-7af62741-50b7-4b6b-94b0-677d0e4cdb53 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/b4ed536b-47ac-4405-a11b-e2ed38021db3" status: 200 len: 1365 microversion: 2.1 time: 0.152002 Jun 30 10:45:55.167844 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 336/679] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:45:55 2022] GET /compute/v2.1/servers/b4ed536b-47ac-4405-a11b-e2ed38021db3 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:45:55.530951 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-c0a1f714-a2a3-45a9-83a0-a58b608ff756 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:55.531553 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-c0a1f714-a2a3-45a9-83a0-a58b608ff756 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:55.537985 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c0a1f714-a2a3-45a9-83a0-a58b608ff756 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:55.538427 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c0a1f714-a2a3-45a9-83a0-a58b608ff756 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:55.539183 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c0a1f714-a2a3-45a9-83a0-a58b608ff756 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:55.539610 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c0a1f714-a2a3-45a9-83a0-a58b608ff756 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:55.667764 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-c0a1f714-a2a3-45a9-83a0-a58b608ff756 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:55.676622 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-c0a1f714-a2a3-45a9-83a0-a58b608ff756 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:55.678099 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-c0a1f714-a2a3-45a9-83a0-a58b608ff756 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:55.679234 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-c0a1f714-a2a3-45a9-83a0-a58b608ff756 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1808 microversion: 2.20 time: 0.152280 Jun 30 10:45:55.679784 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 344/680] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:45:55 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:45:55.877186 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-fccd90bf-c40a-4fce-8e14-e5e1d04a45e3 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:55.877727 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-fccd90bf-c40a-4fce-8e14-e5e1d04a45e3 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:55.883651 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-fccd90bf-c40a-4fce-8e14-e5e1d04a45e3 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:55.884086 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-fccd90bf-c40a-4fce-8e14-e5e1d04a45e3 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:55.884871 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-fccd90bf-c40a-4fce-8e14-e5e1d04a45e3 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:55.885300 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-fccd90bf-c40a-4fce-8e14-e5e1d04a45e3 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:56.008875 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-fccd90bf-c40a-4fce-8e14-e5e1d04a45e3 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:56.017197 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-fccd90bf-c40a-4fce-8e14-e5e1d04a45e3 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1723 microversion: 2.1 time: 0.143862 Jun 30 10:45:56.017755 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 337/681] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:45:55 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1723 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:45:56.184205 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-47e9d95c-c5c9-4dcf-82d2-57775b0665ea tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:56.184845 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-47e9d95c-c5c9-4dcf-82d2-57775b0665ea tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: b4ed536b-47ac-4405-a11b-e2ed38021db3] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:56.190913 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-47e9d95c-c5c9-4dcf-82d2-57775b0665ea tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:56.191361 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-47e9d95c-c5c9-4dcf-82d2-57775b0665ea tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:56.192120 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-47e9d95c-c5c9-4dcf-82d2-57775b0665ea tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:56.192583 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-47e9d95c-c5c9-4dcf-82d2-57775b0665ea tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:56.321426 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-47e9d95c-c5c9-4dcf-82d2-57775b0665ea tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:56.329494 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-47e9d95c-c5c9-4dcf-82d2-57775b0665ea tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/b4ed536b-47ac-4405-a11b-e2ed38021db3" status: 200 len: 1365 microversion: 2.1 time: 0.149159 Jun 30 10:45:56.330064 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 345/682] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:45:56 2022] GET /compute/v2.1/servers/b4ed536b-47ac-4405-a11b-e2ed38021db3 => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:45:56.697274 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-16122438-a9e8-4dea-ad2c-c4d1dcf36066 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:56.697919 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-16122438-a9e8-4dea-ad2c-c4d1dcf36066 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:56.704411 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-16122438-a9e8-4dea-ad2c-c4d1dcf36066 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:56.704889 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-16122438-a9e8-4dea-ad2c-c4d1dcf36066 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:56.705651 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-16122438-a9e8-4dea-ad2c-c4d1dcf36066 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:56.706086 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-16122438-a9e8-4dea-ad2c-c4d1dcf36066 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:56.831413 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-16122438-a9e8-4dea-ad2c-c4d1dcf36066 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:56.839714 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-16122438-a9e8-4dea-ad2c-c4d1dcf36066 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:56.841248 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-16122438-a9e8-4dea-ad2c-c4d1dcf36066 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:56.842401 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-16122438-a9e8-4dea-ad2c-c4d1dcf36066 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1808 microversion: 2.20 time: 0.148982 Jun 30 10:45:56.842956 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 338/683] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:45:56 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1808 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:45:57.034760 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-b4e7a37a-cbaa-4485-ae04-46f204e76f48 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:57.035297 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-b4e7a37a-cbaa-4485-ae04-46f204e76f48 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:57.042504 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b4e7a37a-cbaa-4485-ae04-46f204e76f48 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:57.042954 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b4e7a37a-cbaa-4485-ae04-46f204e76f48 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:57.043720 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b4e7a37a-cbaa-4485-ae04-46f204e76f48 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:57.044154 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b4e7a37a-cbaa-4485-ae04-46f204e76f48 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:57.179600 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-b4e7a37a-cbaa-4485-ae04-46f204e76f48 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:57.187542 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-b4e7a37a-cbaa-4485-ae04-46f204e76f48 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1723 microversion: 2.1 time: 0.157290 Jun 30 10:45:57.188119 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 346/684] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:45:57 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:45:57.346138 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-2586fffc-85f4-4f72-832f-8424c3f69088 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:57.346759 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-2586fffc-85f4-4f72-832f-8424c3f69088 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: b4ed536b-47ac-4405-a11b-e2ed38021db3] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:57.352877 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-2586fffc-85f4-4f72-832f-8424c3f69088 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:57.353324 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-2586fffc-85f4-4f72-832f-8424c3f69088 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:57.354089 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-2586fffc-85f4-4f72-832f-8424c3f69088 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:57.354523 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-2586fffc-85f4-4f72-832f-8424c3f69088 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:57.489005 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-2586fffc-85f4-4f72-832f-8424c3f69088 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:57.496947 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-2586fffc-85f4-4f72-832f-8424c3f69088 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/b4ed536b-47ac-4405-a11b-e2ed38021db3" status: 200 len: 1365 microversion: 2.1 time: 0.155152 Jun 30 10:45:57.498345 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 339/685] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:45:57 2022] GET /compute/v2.1/servers/b4ed536b-47ac-4405-a11b-e2ed38021db3 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:45:57.860239 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-9c16b2e6-9929-4295-8056-7b82a62553ac tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:57.860860 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-9c16b2e6-9929-4295-8056-7b82a62553ac tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:57.866877 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-9c16b2e6-9929-4295-8056-7b82a62553ac tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:57.867322 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-9c16b2e6-9929-4295-8056-7b82a62553ac tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:57.868065 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-9c16b2e6-9929-4295-8056-7b82a62553ac tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:57.868492 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-9c16b2e6-9929-4295-8056-7b82a62553ac tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:57.991807 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-9c16b2e6-9929-4295-8056-7b82a62553ac tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:58.000461 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-9c16b2e6-9929-4295-8056-7b82a62553ac tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:58.001974 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-9c16b2e6-9929-4295-8056-7b82a62553ac tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:58.003107 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-9c16b2e6-9929-4295-8056-7b82a62553ac tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1808 microversion: 2.20 time: 0.146826 Jun 30 10:45:58.003655 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 347/686] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:45:57 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1808 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:45:58.204804 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-1bdf0f53-802d-4356-bb8f-7bb0160d103c tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:58.205416 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-1bdf0f53-802d-4356-bb8f-7bb0160d103c tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:58.211913 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1bdf0f53-802d-4356-bb8f-7bb0160d103c tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:58.212364 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1bdf0f53-802d-4356-bb8f-7bb0160d103c tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:58.213737 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1bdf0f53-802d-4356-bb8f-7bb0160d103c tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:58.214177 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1bdf0f53-802d-4356-bb8f-7bb0160d103c tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:58.347468 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-1bdf0f53-802d-4356-bb8f-7bb0160d103c tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:58.355476 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-1bdf0f53-802d-4356-bb8f-7bb0160d103c tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1700 microversion: 2.1 time: 0.154650 Jun 30 10:45:58.356046 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 340/687] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:45:58 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1700 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:45:58.372352 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-30ce1424-8582-40dd-a52c-2fa3dd4dfe21 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:45:58.379561 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-30ce1424-8582-40dd-a52c-2fa3dd4dfe21 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:58.380003 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-30ce1424-8582-40dd-a52c-2fa3dd4dfe21 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:58.401155 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-30ce1424-8582-40dd-a52c-2fa3dd4dfe21 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Going to try to start instance {{(pid=124203) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 30 10:45:58.433652 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:45:58.442880 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-30ce1424-8582-40dd-a52c-2fa3dd4dfe21 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "POST /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725/action" status: 202 len: 0 microversion: 2.1 time: 0.074282 Jun 30 10:45:58.443468 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 348/688] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Jun 30 10:45:58 2022] POST /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 30 10:45:58.451510 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-336bc7de-5789-45b4-859c-563ce7139d14 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:58.452125 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-336bc7de-5789-45b4-859c-563ce7139d14 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:58.458512 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-336bc7de-5789-45b4-859c-563ce7139d14 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:58.458900 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-336bc7de-5789-45b4-859c-563ce7139d14 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:58.459659 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-336bc7de-5789-45b4-859c-563ce7139d14 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:58.460098 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-336bc7de-5789-45b4-859c-563ce7139d14 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:58.514734 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-c5956959-8705-4a8a-a6fa-d20246fe2c82 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:58.515434 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-c5956959-8705-4a8a-a6fa-d20246fe2c82 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: b4ed536b-47ac-4405-a11b-e2ed38021db3] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:58.521711 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c5956959-8705-4a8a-a6fa-d20246fe2c82 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:58.522162 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c5956959-8705-4a8a-a6fa-d20246fe2c82 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:58.522930 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c5956959-8705-4a8a-a6fa-d20246fe2c82 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:58.523387 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c5956959-8705-4a8a-a6fa-d20246fe2c82 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:58.629609 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-336bc7de-5789-45b4-859c-563ce7139d14 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:58.637593 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-336bc7de-5789-45b4-859c-563ce7139d14 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1709 microversion: 2.1 time: 0.189892 Jun 30 10:45:58.638170 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 341/689] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:45:58 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1709 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:45:58.673053 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-c5956959-8705-4a8a-a6fa-d20246fe2c82 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:58.680410 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-c5956959-8705-4a8a-a6fa-d20246fe2c82 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/b4ed536b-47ac-4405-a11b-e2ed38021db3" status: 200 len: 1365 microversion: 2.1 time: 0.170039 Jun 30 10:45:58.681007 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 349/690] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:45:58 2022] GET /compute/v2.1/servers/b4ed536b-47ac-4405-a11b-e2ed38021db3 => generated 1365 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:45:59.021911 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-c67204a0-e7da-4044-be27-a93fc829bcc3 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:59.022542 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-c67204a0-e7da-4044-be27-a93fc829bcc3 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:59.028849 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c67204a0-e7da-4044-be27-a93fc829bcc3 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:59.029293 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c67204a0-e7da-4044-be27-a93fc829bcc3 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:59.030110 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c67204a0-e7da-4044-be27-a93fc829bcc3 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:59.030543 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c67204a0-e7da-4044-be27-a93fc829bcc3 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:59.168096 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-c67204a0-e7da-4044-be27-a93fc829bcc3 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:59.176647 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-c67204a0-e7da-4044-be27-a93fc829bcc3 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:59.178180 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-c67204a0-e7da-4044-be27-a93fc829bcc3 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:59.179433 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-c67204a0-e7da-4044-be27-a93fc829bcc3 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1808 microversion: 2.20 time: 0.161478 Jun 30 10:45:59.181426 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 342/691] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:45:59 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:45:59.655025 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-bc9121ee-b552-4747-894c-37357066a034 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:59.655645 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-bc9121ee-b552-4747-894c-37357066a034 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:59.662153 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-bc9121ee-b552-4747-894c-37357066a034 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:59.662605 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-bc9121ee-b552-4747-894c-37357066a034 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:59.663360 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-bc9121ee-b552-4747-894c-37357066a034 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:59.663799 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-bc9121ee-b552-4747-894c-37357066a034 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:59.697098 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-50662004-b639-4f7f-bfe0-29aee9ff2189 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:45:59.697824 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-50662004-b639-4f7f-bfe0-29aee9ff2189 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: b4ed536b-47ac-4405-a11b-e2ed38021db3] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:45:59.704483 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-50662004-b639-4f7f-bfe0-29aee9ff2189 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:59.705032 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-50662004-b639-4f7f-bfe0-29aee9ff2189 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:59.705897 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-50662004-b639-4f7f-bfe0-29aee9ff2189 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:45:59.706399 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-50662004-b639-4f7f-bfe0-29aee9ff2189 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:45:59.710465 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_cell1:SELECT=100 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:45:59.842279 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-bc9121ee-b552-4747-894c-37357066a034 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:59.850229 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-bc9121ee-b552-4747-894c-37357066a034 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1709 microversion: 2.1 time: 0.199119 Jun 30 10:45:59.850802 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 350/692] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:45:59 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1709 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:45:59.868711 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-50662004-b639-4f7f-bfe0-29aee9ff2189 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:45:59.876755 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-50662004-b639-4f7f-bfe0-29aee9ff2189 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/b4ed536b-47ac-4405-a11b-e2ed38021db3" status: 200 len: 1365 microversion: 2.1 time: 0.183417 Jun 30 10:45:59.877322 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 343/693] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:45:59 2022] GET /compute/v2.1/servers/b4ed536b-47ac-4405-a11b-e2ed38021db3 => generated 1365 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:46:00.199214 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-9987b7ab-5b05-43b3-a0d9-52455f9d6581 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:46:00.199820 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-9987b7ab-5b05-43b3-a0d9-52455f9d6581 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:46:00.205798 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-9987b7ab-5b05-43b3-a0d9-52455f9d6581 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:46:00.206246 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-9987b7ab-5b05-43b3-a0d9-52455f9d6581 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:46:00.207001 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-9987b7ab-5b05-43b3-a0d9-52455f9d6581 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:46:00.207436 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-9987b7ab-5b05-43b3-a0d9-52455f9d6581 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:46:00.334990 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-9987b7ab-5b05-43b3-a0d9-52455f9d6581 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:46:00.343407 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-9987b7ab-5b05-43b3-a0d9-52455f9d6581 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:46:00.345580 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-9987b7ab-5b05-43b3-a0d9-52455f9d6581 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:46:00.346742 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-9987b7ab-5b05-43b3-a0d9-52455f9d6581 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1808 microversion: 2.20 time: 0.151457 Jun 30 10:46:00.347301 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 351/694] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:46:00 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:46:00.868923 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-49faf72d-3ede-4e5a-9701-70d4ff58f5c3 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:46:00.869473 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-49faf72d-3ede-4e5a-9701-70d4ff58f5c3 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:46:00.876384 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-49faf72d-3ede-4e5a-9701-70d4ff58f5c3 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:46:00.876852 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-49faf72d-3ede-4e5a-9701-70d4ff58f5c3 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:46:00.877601 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-49faf72d-3ede-4e5a-9701-70d4ff58f5c3 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:46:00.878030 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-49faf72d-3ede-4e5a-9701-70d4ff58f5c3 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:46:00.893991 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-4e063a5f-f395-405d-96dd-f2a568673b70 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:46:00.894603 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-4e063a5f-f395-405d-96dd-f2a568673b70 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: b4ed536b-47ac-4405-a11b-e2ed38021db3] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:46:00.900995 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-4e063a5f-f395-405d-96dd-f2a568673b70 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:46:00.901444 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-4e063a5f-f395-405d-96dd-f2a568673b70 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:46:00.902213 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-4e063a5f-f395-405d-96dd-f2a568673b70 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:46:00.902656 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-4e063a5f-f395-405d-96dd-f2a568673b70 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:46:01.079846 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-49faf72d-3ede-4e5a-9701-70d4ff58f5c3 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:46:01.082887 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-4e063a5f-f395-405d-96dd-f2a568673b70 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:46:01.087918 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-49faf72d-3ede-4e5a-9701-70d4ff58f5c3 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1709 microversion: 2.1 time: 0.222881 Jun 30 10:46:01.088572 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 344/695] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:46:00 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1709 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:46:01.090553 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-4e063a5f-f395-405d-96dd-f2a568673b70 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/b4ed536b-47ac-4405-a11b-e2ed38021db3" status: 200 len: 1555 microversion: 2.1 time: 0.201008 Jun 30 10:46:01.091121 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 352/696] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:46:00 2022] GET /compute/v2.1/servers/b4ed536b-47ac-4405-a11b-e2ed38021db3 => generated 1555 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:46:01.107512 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-cd21fdea-4742-4320-8027-7e720c8a4b57 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:46:01.108088 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-cd21fdea-4742-4320-8027-7e720c8a4b57 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: b4ed536b-47ac-4405-a11b-e2ed38021db3] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:46:01.115060 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-cd21fdea-4742-4320-8027-7e720c8a4b57 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:46:01.115517 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-cd21fdea-4742-4320-8027-7e720c8a4b57 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:46:01.116270 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-cd21fdea-4742-4320-8027-7e720c8a4b57 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:46:01.116741 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-cd21fdea-4742-4320-8027-7e720c8a4b57 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:46:01.197281 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-cd21fdea-4742-4320-8027-7e720c8a4b57 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/b4ed536b-47ac-4405-a11b-e2ed38021db3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094409 Jun 30 10:46:01.197880 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 345/697] 10.222.0.59 () {58 vars in 1274 bytes} [Thu Jun 30 10:46:01 2022] GET /compute/v2.1/servers/b4ed536b-47ac-4405-a11b-e2ed38021db3/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:46:01.365579 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-e3462f42-9da2-47d2-a043-7c6e96405c29 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:46:01.366178 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-e3462f42-9da2-47d2-a043-7c6e96405c29 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:46:01.372440 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e3462f42-9da2-47d2-a043-7c6e96405c29 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:46:01.372865 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e3462f42-9da2-47d2-a043-7c6e96405c29 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:46:01.373624 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e3462f42-9da2-47d2-a043-7c6e96405c29 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:46:01.374050 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e3462f42-9da2-47d2-a043-7c6e96405c29 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:46:01.606146 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-e3462f42-9da2-47d2-a043-7c6e96405c29 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:46:01.615511 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-e3462f42-9da2-47d2-a043-7c6e96405c29 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:46:01.617100 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-e3462f42-9da2-47d2-a043-7c6e96405c29 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:46:01.618269 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-e3462f42-9da2-47d2-a043-7c6e96405c29 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1808 microversion: 2.20 time: 0.256578 Jun 30 10:46:01.618829 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 353/698] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:46:01 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1808 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:46:02.105494 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-641b120f-e698-44c0-acdb-11df411bbaf6 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:46:02.106152 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-641b120f-e698-44c0-acdb-11df411bbaf6 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:46:02.113354 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-641b120f-e698-44c0-acdb-11df411bbaf6 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:46:02.113797 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-641b120f-e698-44c0-acdb-11df411bbaf6 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:46:02.114556 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-641b120f-e698-44c0-acdb-11df411bbaf6 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:46:02.114988 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-641b120f-e698-44c0-acdb-11df411bbaf6 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:46:02.193979 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [req-990903c5-011f-4dd3-9457-cc95a15b5c18 req-31d9c523-6c28-4b44-ab9e-49ead1be7f4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4ed536b-47ac-4405-a11b-e2ed38021db3", "tag": "650e7205-eab8-4f78-9a90-22d014fc7c86"}]} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:46:02.203449 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-990903c5-011f-4dd3-9457-cc95a15b5c18 req-31d9c523-6c28-4b44-ab9e-49ead1be7f4c service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:46:02.203908 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-990903c5-011f-4dd3-9457-cc95a15b5c18 req-31d9c523-6c28-4b44-ab9e-49ead1be7f4c service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:46:02.216184 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.compute.server_external_events [req-990903c5-011f-4dd3-9457-cc95a15b5c18 req-31d9c523-6c28-4b44-ab9e-49ead1be7f4c service nova] Creating event network-changed:650e7205-eab8-4f78-9a90-22d014fc7c86 for instance b4ed536b-47ac-4405-a11b-e2ed38021db3 on hv-cinder-82282 Jun 30 10:46:02.221863 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [req-990903c5-011f-4dd3-9457-cc95a15b5c18 req-31d9c523-6c28-4b44-ab9e-49ead1be7f4c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031538 Jun 30 10:46:02.222467 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 354/699] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:46:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 10:46:02.274929 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-641b120f-e698-44c0-acdb-11df411bbaf6 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:46:02.285430 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-641b120f-e698-44c0-acdb-11df411bbaf6 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1713 microversion: 2.1 time: 0.184186 Jun 30 10:46:02.286011 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 346/700] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:46:02 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1713 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:46:02.637287 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-c861e1aa-dcfd-4977-881b-4b90a56c5e09 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:46:02.637979 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-c861e1aa-dcfd-4977-881b-4b90a56c5e09 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:46:02.644721 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c861e1aa-dcfd-4977-881b-4b90a56c5e09 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:46:02.645160 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c861e1aa-dcfd-4977-881b-4b90a56c5e09 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:46:02.645927 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c861e1aa-dcfd-4977-881b-4b90a56c5e09 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:46:02.646353 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c861e1aa-dcfd-4977-881b-4b90a56c5e09 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:46:02.795798 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-c861e1aa-dcfd-4977-881b-4b90a56c5e09 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:46:02.804443 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-c861e1aa-dcfd-4977-881b-4b90a56c5e09 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:46:02.806003 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-c861e1aa-dcfd-4977-881b-4b90a56c5e09 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:46:02.807253 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-c861e1aa-dcfd-4977-881b-4b90a56c5e09 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1808 microversion: 2.20 time: 0.174198 Jun 30 10:46:02.807882 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 355/701] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:46:02 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:46:03.825615 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-008cab6a-fa97-48e0-ae1f-a559fe5bdb2e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:46:03.826223 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-008cab6a-fa97-48e0-ae1f-a559fe5bdb2e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:46:03.832960 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-008cab6a-fa97-48e0-ae1f-a559fe5bdb2e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:46:03.833412 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-008cab6a-fa97-48e0-ae1f-a559fe5bdb2e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:46:03.834174 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-008cab6a-fa97-48e0-ae1f-a559fe5bdb2e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:46:03.834610 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-008cab6a-fa97-48e0-ae1f-a559fe5bdb2e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:46:03.958626 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-008cab6a-fa97-48e0-ae1f-a559fe5bdb2e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:46:03.966962 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-008cab6a-fa97-48e0-ae1f-a559fe5bdb2e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:46:03.968458 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-008cab6a-fa97-48e0-ae1f-a559fe5bdb2e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:46:03.970125 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-008cab6a-fa97-48e0-ae1f-a559fe5bdb2e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1808 microversion: 2.20 time: 0.148427 Jun 30 10:46:03.970690 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 347/702] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:46:03 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1808 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:46:04.988921 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-02f6a15b-5742-49e6-97d6-20bd72fc8b5f tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:46:04.989524 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-02f6a15b-5742-49e6-97d6-20bd72fc8b5f tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:46:04.996064 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-02f6a15b-5742-49e6-97d6-20bd72fc8b5f tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:46:04.996526 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-02f6a15b-5742-49e6-97d6-20bd72fc8b5f tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:46:04.997303 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-02f6a15b-5742-49e6-97d6-20bd72fc8b5f tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:46:04.997738 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-02f6a15b-5742-49e6-97d6-20bd72fc8b5f tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:46:05.123298 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-02f6a15b-5742-49e6-97d6-20bd72fc8b5f tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:46:05.132860 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-02f6a15b-5742-49e6-97d6-20bd72fc8b5f tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:46:05.134381 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-02f6a15b-5742-49e6-97d6-20bd72fc8b5f tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:46:05.135542 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-02f6a15b-5742-49e6-97d6-20bd72fc8b5f tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1808 microversion: 2.20 time: 0.150496 Jun 30 10:46:05.136108 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 356/703] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:46:04 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:46:06.155017 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-6a8d193a-e63c-4239-b507-08ee7ff2dea2 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:46:06.155621 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-6a8d193a-e63c-4239-b507-08ee7ff2dea2 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:46:06.162162 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6a8d193a-e63c-4239-b507-08ee7ff2dea2 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:46:06.162607 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6a8d193a-e63c-4239-b507-08ee7ff2dea2 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:46:06.163396 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6a8d193a-e63c-4239-b507-08ee7ff2dea2 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:46:06.163827 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6a8d193a-e63c-4239-b507-08ee7ff2dea2 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:46:06.478887 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-6a8d193a-e63c-4239-b507-08ee7ff2dea2 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:46:06.487955 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-6a8d193a-e63c-4239-b507-08ee7ff2dea2 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:46:06.489471 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-6a8d193a-e63c-4239-b507-08ee7ff2dea2 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:46:06.490614 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-6a8d193a-e63c-4239-b507-08ee7ff2dea2 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1808 microversion: 2.20 time: 0.339569 Jun 30 10:46:06.491179 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 348/704] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:46:06 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1808 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:46:07.509301 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-708fe7da-1d9f-4472-8d18-037c28bd3f2c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:46:07.509900 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-708fe7da-1d9f-4472-8d18-037c28bd3f2c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:46:07.517048 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-708fe7da-1d9f-4472-8d18-037c28bd3f2c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:46:07.517488 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-708fe7da-1d9f-4472-8d18-037c28bd3f2c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:46:07.518237 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-708fe7da-1d9f-4472-8d18-037c28bd3f2c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:46:07.518671 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-708fe7da-1d9f-4472-8d18-037c28bd3f2c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:46:07.651486 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-708fe7da-1d9f-4472-8d18-037c28bd3f2c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:46:07.660214 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-708fe7da-1d9f-4472-8d18-037c28bd3f2c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:46:07.661778 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-708fe7da-1d9f-4472-8d18-037c28bd3f2c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:46:07.662947 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-708fe7da-1d9f-4472-8d18-037c28bd3f2c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1808 microversion: 2.20 time: 0.157594 Jun 30 10:46:07.663698 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 357/705] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:46:07 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:46:07.804446 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [req-b5ea7c0c-975d-4338-9eb1-cf151f6f1956 req-aadcfc18-995c-421b-976e-a10d22ff2b21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af0d59b6-8e95-4947-803a-c1d952e218c8", "name": "network-vif-plugged", "status": "completed", "tag": "ec009e37-3070-46e8-8a9a-513065a2c654"}]} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:46:07.813259 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-b5ea7c0c-975d-4338-9eb1-cf151f6f1956 req-aadcfc18-995c-421b-976e-a10d22ff2b21 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:46:07.813696 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-b5ea7c0c-975d-4338-9eb1-cf151f6f1956 req-aadcfc18-995c-421b-976e-a10d22ff2b21 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:46:07.824282 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.compute.server_external_events [req-b5ea7c0c-975d-4338-9eb1-cf151f6f1956 req-aadcfc18-995c-421b-976e-a10d22ff2b21 service nova] Creating event network-vif-plugged:ec009e37-3070-46e8-8a9a-513065a2c654 for instance af0d59b6-8e95-4947-803a-c1d952e218c8 on hv-cinder-82282 Jun 30 10:46:07.829714 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [req-b5ea7c0c-975d-4338-9eb1-cf151f6f1956 req-aadcfc18-995c-421b-976e-a10d22ff2b21 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088758 Jun 30 10:46:07.830283 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 349/706] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:46:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:46:08.681686 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-3cd1e3c3-588d-4f99-a27c-1fab166c7f7d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:46:08.682280 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-3cd1e3c3-588d-4f99-a27c-1fab166c7f7d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:46:08.689302 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-3cd1e3c3-588d-4f99-a27c-1fab166c7f7d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:46:08.689741 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-3cd1e3c3-588d-4f99-a27c-1fab166c7f7d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:46:08.690488 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-3cd1e3c3-588d-4f99-a27c-1fab166c7f7d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:46:08.690916 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-3cd1e3c3-588d-4f99-a27c-1fab166c7f7d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:46:08.823784 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-3cd1e3c3-588d-4f99-a27c-1fab166c7f7d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:46:08.831991 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-3cd1e3c3-588d-4f99-a27c-1fab166c7f7d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:46:08.833484 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-3cd1e3c3-588d-4f99-a27c-1fab166c7f7d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:46:08.834651 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-3cd1e3c3-588d-4f99-a27c-1fab166c7f7d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1808 microversion: 2.20 time: 0.156789 Jun 30 10:46:08.835199 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 358/707] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:46:08 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:46:09.853131 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-ca607880-a849-40c9-9825-20afece1a26f tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:46:09.853835 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-ca607880-a849-40c9-9825-20afece1a26f tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:46:09.855744 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_api:SELECT=68 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:46:09.861705 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ca607880-a849-40c9-9825-20afece1a26f tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:46:09.862152 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ca607880-a849-40c9-9825-20afece1a26f tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:46:09.862905 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ca607880-a849-40c9-9825-20afece1a26f tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:46:09.863338 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ca607880-a849-40c9-9825-20afece1a26f tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:46:09.988494 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-ca607880-a849-40c9-9825-20afece1a26f tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:46:09.996782 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-ca607880-a849-40c9-9825-20afece1a26f tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:46:09.998273 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-ca607880-a849-40c9-9825-20afece1a26f tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:46:09.999426 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-ca607880-a849-40c9-9825-20afece1a26f tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1808 microversion: 2.20 time: 0.151102 Jun 30 10:46:10.000478 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 350/708] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:46:09 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:46:11.018211 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-c09d05e6-f7f7-4855-a80b-84bf43e38b74 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:46:11.018822 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-c09d05e6-f7f7-4855-a80b-84bf43e38b74 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:46:11.020846 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_api:SELECT=68 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:46:11.026119 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c09d05e6-f7f7-4855-a80b-84bf43e38b74 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:46:11.026567 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c09d05e6-f7f7-4855-a80b-84bf43e38b74 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:46:11.027322 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c09d05e6-f7f7-4855-a80b-84bf43e38b74 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:46:11.027751 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c09d05e6-f7f7-4855-a80b-84bf43e38b74 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:46:11.157239 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-c09d05e6-f7f7-4855-a80b-84bf43e38b74 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:46:11.172829 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-c09d05e6-f7f7-4855-a80b-84bf43e38b74 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:46:11.174313 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-c09d05e6-f7f7-4855-a80b-84bf43e38b74 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:46:11.175477 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-c09d05e6-f7f7-4855-a80b-84bf43e38b74 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1795 microversion: 2.20 time: 0.161349 Jun 30 10:46:11.176026 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 359/709] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:46:11 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1795 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:46:14.877252 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-2392fbf1-7534-4916-a7b7-85db8998c7ef tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a4b931f6-9989-49b8-8842-9b618fb82025"}} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:46:14.878325 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-2392fbf1-7534-4916-a7b7-85db8998c7ef tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 3ec80ef6-338b-4924-98e0-295bcb858dd9] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:46:14.884331 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-2392fbf1-7534-4916-a7b7-85db8998c7ef tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:46:14.885198 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-2392fbf1-7534-4916-a7b7-85db8998c7ef tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:46:14.885642 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-2392fbf1-7534-4916-a7b7-85db8998c7ef tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:46:14.886111 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-2392fbf1-7534-4916-a7b7-85db8998c7ef tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:46:15.127191 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-2392fbf1-7534-4916-a7b7-85db8998c7ef tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "POST /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.351907 Jun 30 10:46:15.127793 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 351/710] 10.222.0.59 () {60 vars in 1322 bytes} [Thu Jun 30 10:46:14 2022] POST /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9/os-volume_attachments => generated 194 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:46:22.606131 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-e65a8bb2-acac-4c21-bc09-75980ff301fe tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:46:22.607386 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-e65a8bb2-acac-4c21-bc09-75980ff301fe tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 3ec80ef6-338b-4924-98e0-295bcb858dd9] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:46:22.609873 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_api:SELECT=1 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:46:22.610547 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=62 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:46:22.616417 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e65a8bb2-acac-4c21-bc09-75980ff301fe tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:46:22.616893 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e65a8bb2-acac-4c21-bc09-75980ff301fe tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:46:22.617657 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e65a8bb2-acac-4c21-bc09-75980ff301fe tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:46:22.618096 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e65a8bb2-acac-4c21-bc09-75980ff301fe tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:46:22.641728 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.objects.instance [None req-e65a8bb2-acac-4c21-bc09-75980ff301fe tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lazy-loading 'flavor' on Instance uuid 3ec80ef6-338b-4924-98e0-295bcb858dd9 {{(pid=124203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 10:46:22.760062 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-e65a8bb2-acac-4c21-bc09-75980ff301fe tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "POST /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9/action" status: 200 len: 32 microversion: 2.1 time: 0.157845 Jun 30 10:46:22.760711 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 360/711] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Jun 30 10:46:22 2022] POST /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9/action => generated 32 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 30 10:46:22.772030 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-12205fe0-a904-4bee-b714-1734d7376dc8 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:46:22.773241 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-12205fe0-a904-4bee-b714-1734d7376dc8 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 3ec80ef6-338b-4924-98e0-295bcb858dd9] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:46:22.781913 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-12205fe0-a904-4bee-b714-1734d7376dc8 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:46:22.782642 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-12205fe0-a904-4bee-b714-1734d7376dc8 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:46:22.783553 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-12205fe0-a904-4bee-b714-1734d7376dc8 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:46:22.784089 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-12205fe0-a904-4bee-b714-1734d7376dc8 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:46:22.913792 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-12205fe0-a904-4bee-b714-1734d7376dc8 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:46:22.922297 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-12205fe0-a904-4bee-b714-1734d7376dc8 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9" status: 200 len: 1737 microversion: 2.1 time: 0.156135 Jun 30 10:46:22.922872 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 352/712] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:46:22 2022] GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:46:23.940186 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-b18c07af-258c-44a2-9ada-0b60fee82d57 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:46:23.940932 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-b18c07af-258c-44a2-9ada-0b60fee82d57 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 3ec80ef6-338b-4924-98e0-295bcb858dd9] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:46:23.946993 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b18c07af-258c-44a2-9ada-0b60fee82d57 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:46:23.947475 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b18c07af-258c-44a2-9ada-0b60fee82d57 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:46:23.948226 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b18c07af-258c-44a2-9ada-0b60fee82d57 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:46:23.948690 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b18c07af-258c-44a2-9ada-0b60fee82d57 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:46:24.074943 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-b18c07af-258c-44a2-9ada-0b60fee82d57 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:46:24.083428 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-b18c07af-258c-44a2-9ada-0b60fee82d57 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9" status: 200 len: 1737 microversion: 2.1 time: 0.148046 Jun 30 10:46:24.084001 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 361/713] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:46:23 2022] GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9 => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:46:25.100413 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-a966c334-9626-43d7-8cc3-67bb949b432d tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:46:25.101082 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-a966c334-9626-43d7-8cc3-67bb949b432d tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 3ec80ef6-338b-4924-98e0-295bcb858dd9] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:46:25.107873 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a966c334-9626-43d7-8cc3-67bb949b432d tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:46:25.108324 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a966c334-9626-43d7-8cc3-67bb949b432d tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:46:25.109286 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a966c334-9626-43d7-8cc3-67bb949b432d tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:46:25.109961 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a966c334-9626-43d7-8cc3-67bb949b432d tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:46:25.241380 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-a966c334-9626-43d7-8cc3-67bb949b432d tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:46:25.249363 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-a966c334-9626-43d7-8cc3-67bb949b432d tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9" status: 200 len: 1737 microversion: 2.1 time: 0.152792 Jun 30 10:46:25.249937 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 353/714] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:46:25 2022] GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:46:26.266804 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-89094dcd-b655-422f-8cc7-e1b2263be636 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:46:26.267409 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-89094dcd-b655-422f-8cc7-e1b2263be636 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 3ec80ef6-338b-4924-98e0-295bcb858dd9] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:46:26.274024 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-89094dcd-b655-422f-8cc7-e1b2263be636 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:46:26.274470 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-89094dcd-b655-422f-8cc7-e1b2263be636 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:46:26.275221 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-89094dcd-b655-422f-8cc7-e1b2263be636 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:46:26.275654 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-89094dcd-b655-422f-8cc7-e1b2263be636 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:46:26.400532 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-89094dcd-b655-422f-8cc7-e1b2263be636 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:46:26.408968 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-89094dcd-b655-422f-8cc7-e1b2263be636 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9" status: 200 len: 1737 microversion: 2.1 time: 0.146141 Jun 30 10:46:26.409528 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 362/715] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:46:26 2022] GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9 => generated 1737 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:46:27.426336 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-4d631532-3bf4-4092-8b38-d0b0f1e565aa tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:46:27.426942 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-4d631532-3bf4-4092-8b38-d0b0f1e565aa tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 3ec80ef6-338b-4924-98e0-295bcb858dd9] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:46:27.433427 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-4d631532-3bf4-4092-8b38-d0b0f1e565aa tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:46:27.433870 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-4d631532-3bf4-4092-8b38-d0b0f1e565aa tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:46:27.434621 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-4d631532-3bf4-4092-8b38-d0b0f1e565aa tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:46:27.435054 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-4d631532-3bf4-4092-8b38-d0b0f1e565aa tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:46:27.564263 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-4d631532-3bf4-4092-8b38-d0b0f1e565aa tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:46:27.572204 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-4d631532-3bf4-4092-8b38-d0b0f1e565aa tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9" status: 200 len: 1737 microversion: 2.1 time: 0.149711 Jun 30 10:46:27.572807 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 354/716] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:46:27 2022] GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:46:28.589313 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-3758816c-35c1-4dcb-8dfb-ea3441b8ddde tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:46:28.589825 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-3758816c-35c1-4dcb-8dfb-ea3441b8ddde tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 3ec80ef6-338b-4924-98e0-295bcb858dd9] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:46:28.596254 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-3758816c-35c1-4dcb-8dfb-ea3441b8ddde tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:46:28.596736 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-3758816c-35c1-4dcb-8dfb-ea3441b8ddde tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:46:28.597496 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-3758816c-35c1-4dcb-8dfb-ea3441b8ddde tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:46:28.597934 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-3758816c-35c1-4dcb-8dfb-ea3441b8ddde tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:46:28.723830 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-3758816c-35c1-4dcb-8dfb-ea3441b8ddde tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:46:28.732025 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-3758816c-35c1-4dcb-8dfb-ea3441b8ddde tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9" status: 200 len: 1737 microversion: 2.1 time: 0.146322 Jun 30 10:46:28.732612 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 363/717] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:46:28 2022] GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9 => generated 1737 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:46:29.748617 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-e5af549e-0ccb-4e40-a0e1-bf46bb012777 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:46:29.749162 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-e5af549e-0ccb-4e40-a0e1-bf46bb012777 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 3ec80ef6-338b-4924-98e0-295bcb858dd9] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:46:29.755704 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-e5af549e-0ccb-4e40-a0e1-bf46bb012777 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:46:29.756149 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-e5af549e-0ccb-4e40-a0e1-bf46bb012777 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:46:29.756949 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-e5af549e-0ccb-4e40-a0e1-bf46bb012777 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:46:29.757383 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-e5af549e-0ccb-4e40-a0e1-bf46bb012777 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:46:29.760036 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:46:29.884493 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-e5af549e-0ccb-4e40-a0e1-bf46bb012777 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:46:29.892942 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-e5af549e-0ccb-4e40-a0e1-bf46bb012777 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9" status: 200 len: 1737 microversion: 2.1 time: 0.148267 Jun 30 10:46:29.893515 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 355/718] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:46:29 2022] GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9 => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:46:30.909530 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-c928083d-1b9b-4260-9636-ce11f279737a tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:46:30.910125 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-c928083d-1b9b-4260-9636-ce11f279737a tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 3ec80ef6-338b-4924-98e0-295bcb858dd9] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:46:30.916488 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c928083d-1b9b-4260-9636-ce11f279737a tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:46:30.916953 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c928083d-1b9b-4260-9636-ce11f279737a tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:46:30.917701 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c928083d-1b9b-4260-9636-ce11f279737a tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:46:30.918126 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c928083d-1b9b-4260-9636-ce11f279737a tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:46:31.048820 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-c928083d-1b9b-4260-9636-ce11f279737a tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:46:31.056817 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-c928083d-1b9b-4260-9636-ce11f279737a tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9" status: 200 len: 1737 microversion: 2.1 time: 0.151535 Jun 30 10:46:31.057396 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 364/719] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:46:30 2022] GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:46:32.073850 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-92add370-b326-493c-823a-ce657ed4c9d3 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:46:32.074462 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-92add370-b326-493c-823a-ce657ed4c9d3 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 3ec80ef6-338b-4924-98e0-295bcb858dd9] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:46:32.081583 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-92add370-b326-493c-823a-ce657ed4c9d3 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:46:32.082030 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-92add370-b326-493c-823a-ce657ed4c9d3 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:46:32.082788 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-92add370-b326-493c-823a-ce657ed4c9d3 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:46:32.083223 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-92add370-b326-493c-823a-ce657ed4c9d3 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:46:32.207880 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-92add370-b326-493c-823a-ce657ed4c9d3 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:46:32.215831 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-92add370-b326-493c-823a-ce657ed4c9d3 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9" status: 200 len: 1737 microversion: 2.1 time: 0.145790 Jun 30 10:46:32.216394 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 356/720] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:46:32 2022] GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9 => generated 1737 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:46:33.233771 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-d57ddd36-fb07-4624-9226-da0839c269a3 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:46:33.234376 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-d57ddd36-fb07-4624-9226-da0839c269a3 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 3ec80ef6-338b-4924-98e0-295bcb858dd9] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:46:33.240969 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-d57ddd36-fb07-4624-9226-da0839c269a3 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:46:33.241413 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-d57ddd36-fb07-4624-9226-da0839c269a3 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:46:33.242166 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-d57ddd36-fb07-4624-9226-da0839c269a3 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:46:33.242601 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-d57ddd36-fb07-4624-9226-da0839c269a3 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:46:33.371697 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-d57ddd36-fb07-4624-9226-da0839c269a3 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:46:33.380224 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-d57ddd36-fb07-4624-9226-da0839c269a3 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9" status: 200 len: 1737 microversion: 2.1 time: 0.150537 Jun 30 10:46:33.380828 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 365/721] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:46:33 2022] GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:46:34.397269 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-94992b36-e70f-4155-bdc6-02914cf54209 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:46:34.397885 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-94992b36-e70f-4155-bdc6-02914cf54209 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 3ec80ef6-338b-4924-98e0-295bcb858dd9] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:46:34.404574 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-94992b36-e70f-4155-bdc6-02914cf54209 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:46:34.405023 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-94992b36-e70f-4155-bdc6-02914cf54209 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:46:34.406447 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-94992b36-e70f-4155-bdc6-02914cf54209 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:46:34.406880 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-94992b36-e70f-4155-bdc6-02914cf54209 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:46:34.532822 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-94992b36-e70f-4155-bdc6-02914cf54209 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:46:34.540588 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-94992b36-e70f-4155-bdc6-02914cf54209 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9" status: 200 len: 1737 microversion: 2.1 time: 0.147206 Jun 30 10:46:34.541153 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 357/722] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:46:34 2022] GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9 => generated 1737 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:46:35.557462 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-1abe125c-a0b0-4ebc-9d4b-cf7117e153f7 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:46:35.558066 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-1abe125c-a0b0-4ebc-9d4b-cf7117e153f7 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 3ec80ef6-338b-4924-98e0-295bcb858dd9] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:46:35.564702 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-1abe125c-a0b0-4ebc-9d4b-cf7117e153f7 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:46:35.565153 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-1abe125c-a0b0-4ebc-9d4b-cf7117e153f7 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:46:35.565907 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-1abe125c-a0b0-4ebc-9d4b-cf7117e153f7 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:46:35.566338 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-1abe125c-a0b0-4ebc-9d4b-cf7117e153f7 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:46:35.704915 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-1abe125c-a0b0-4ebc-9d4b-cf7117e153f7 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:46:35.712959 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-1abe125c-a0b0-4ebc-9d4b-cf7117e153f7 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9" status: 200 len: 1737 microversion: 2.1 time: 0.159343 Jun 30 10:46:35.713538 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 366/723] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:46:35 2022] GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9 => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:46:36.730522 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-1d7c8d95-0310-44c3-9afa-089a84e2a4cb tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:46:36.731127 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-1d7c8d95-0310-44c3-9afa-089a84e2a4cb tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 3ec80ef6-338b-4924-98e0-295bcb858dd9] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:46:36.738591 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1d7c8d95-0310-44c3-9afa-089a84e2a4cb tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:46:36.739033 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1d7c8d95-0310-44c3-9afa-089a84e2a4cb tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:46:36.739788 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1d7c8d95-0310-44c3-9afa-089a84e2a4cb tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:46:36.740221 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1d7c8d95-0310-44c3-9afa-089a84e2a4cb tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:46:36.868263 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-1d7c8d95-0310-44c3-9afa-089a84e2a4cb tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:46:36.876174 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-1d7c8d95-0310-44c3-9afa-089a84e2a4cb tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9" status: 200 len: 1737 microversion: 2.1 time: 0.149523 Jun 30 10:46:36.876770 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 358/724] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:46:36 2022] GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:46:37.893127 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-9058ec88-a744-40d5-87c5-b1752260abdc tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:46:37.893706 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-9058ec88-a744-40d5-87c5-b1752260abdc tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 3ec80ef6-338b-4924-98e0-295bcb858dd9] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:46:37.900085 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-9058ec88-a744-40d5-87c5-b1752260abdc tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:46:37.900548 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-9058ec88-a744-40d5-87c5-b1752260abdc tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:46:37.901301 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-9058ec88-a744-40d5-87c5-b1752260abdc tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:46:37.901730 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-9058ec88-a744-40d5-87c5-b1752260abdc tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:46:38.028690 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-9058ec88-a744-40d5-87c5-b1752260abdc tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:46:38.036861 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-9058ec88-a744-40d5-87c5-b1752260abdc tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9" status: 200 len: 1717 microversion: 2.1 time: 0.147531 Jun 30 10:46:38.037422 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 367/725] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:46:37 2022] GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9 => generated 1717 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:46:38.090311 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-9df0d13f-7ad7-4b14-ae33-78b79e2fd616 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:46:38.090802 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-9df0d13f-7ad7-4b14-ae33-78b79e2fd616 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 3ec80ef6-338b-4924-98e0-295bcb858dd9] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:46:38.097321 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-9df0d13f-7ad7-4b14-ae33-78b79e2fd616 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:46:38.097777 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-9df0d13f-7ad7-4b14-ae33-78b79e2fd616 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:46:38.098536 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-9df0d13f-7ad7-4b14-ae33-78b79e2fd616 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:46:38.098970 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-9df0d13f-7ad7-4b14-ae33-78b79e2fd616 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:46:38.180139 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.wsgi [None req-9df0d13f-7ad7-4b14-ae33-78b79e2fd616 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] HTTP exception thrown: Cannot 'detach_volume' instance 3ec80ef6-338b-4924-98e0-295bcb858dd9 while it is in vm_state rescued Jun 30 10:46:38.182151 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-9df0d13f-7ad7-4b14-ae33-78b79e2fd616 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Request method failure captured: Jun 30 10:46:38.182151 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: request: DELETE /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9/os-volume_attachments/a4b931f6-9989-49b8-8842-9b618fb82025 HTTP/1.1 Jun 30 10:46:38.182151 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Accept: application/json Jun 30 10:46:38.182151 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Accept-Encoding: identity Jun 30 10:46:38.182151 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Connection: close Jun 30 10:46:38.182151 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Content-Length: 0 Jun 30 10:46:38.182151 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Content-Type: application/json Jun 30 10:46:38.182151 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Host: 10.222.0.59 Jun 30 10:46:38.182151 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Openstack-System-Scope: None Jun 30 10:46:38.182151 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: User-Agent: python-urllib3/1.26.9 Jun 30 10:46:38.182151 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Auth-Token: gAAAAABivX2IaMKFb8aVjIO9EozePX71KBEfwyqcUMe3SvB2sa7oqzpACr1t048jevq1HnxAZYOcYQ9yz3sn3Mi-zB8W1WY1FWJvqYQmDU-ufetM9QN3XiPs0N0Ey6_49zVeCFmscnoJJ-2J3rZ2Q476IEMQO-fq6f0WYCxQpJ-MOJQFC-ZWmEU Jun 30 10:46:38.182151 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Domain-Id: None Jun 30 10:46:38.182151 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Domain-Name: None Jun 30 10:46:38.182151 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Identity-Status: Confirmed Jun 30 10:46:38.182151 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Is-Admin-Project: True Jun 30 10:46:38.182151 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Domain-Id: default Jun 30 10:46:38.182151 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Domain-Name: Default Jun 30 10:46:38.182151 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Id: 0e38b1cc4c0d45a8b38ba7b670f83c79 Jun 30 10:46:38.182151 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1656404926 Jun 30 10:46:38.182151 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Role: member,reader Jun 30 10:46:38.182151 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Roles: member,reader Jun 30 10:46:38.183670 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0e38b1cc4c0d45a8b38ba7b670f83c79"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0e38b1cc4c0d45a8b38ba7b670f83c79"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0e38b1cc4c0d45a8b38ba7b670f83c79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0e38b1cc4c0d45a8b38ba7b670f83c79"}]}] Jun 30 10:46:38.183670 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1656404926 Jun 30 10:46:38.183670 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant-Id: 0e38b1cc4c0d45a8b38ba7b670f83c79 Jun 30 10:46:38.183670 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1656404926 Jun 30 10:46:38.183670 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User: tempest-ServerRescueNegativeTestJSON-1656404926-project Jun 30 10:46:38.183670 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Domain-Id: default Jun 30 10:46:38.183670 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Domain-Name: Default Jun 30 10:46:38.183670 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Id: 6c963986b46d4d148fc843b0a1183d69 Jun 30 10:46:38.183670 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1656404926-project Jun 30 10:46:38.183670 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: method: > Jun 30 10:46:38.183670 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: exception: Cannot 'detach_volume' instance 3ec80ef6-338b-4924-98e0-295bcb858dd9 while it is in vm_state rescued Jun 30 10:46:38.184481 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: action_args: {'server_id': '3ec80ef6-338b-4924-98e0-295bcb858dd9', 'id': 'a4b931f6-9989-49b8-8842-9b618fb82025'} Jun 30 10:46:38.184481 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:46:38.184481 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:46:38.184481 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 30 10:46:38.184481 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 30 10:46:38.184481 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 30 10:46:38.184481 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 30 10:46:38.184481 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 30 10:46:38.184481 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 30 10:46:38.184481 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3ec80ef6-338b-4924-98e0-295bcb858dd9 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 30 10:46:38.184481 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:46:38.184481 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:46:38.184481 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:46:38.184481 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:46:38.184481 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:46:38.184481 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:46:38.184481 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:46:38.184481 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:46:38.184481 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:46:38.184481 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:46:38.185815 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 30 10:46:38.185815 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 30 10:46:38.185815 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 30 10:46:38.185815 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 30 10:46:38.185815 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 3ec80ef6-338b-4924-98e0-295bcb858dd9 while it is in vm_state rescued Jun 30 10:46:38.185815 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:46:38.185815 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:46:38.185815 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:46:38.185815 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:46:38.185815 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:46:38.185815 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:46:38.185815 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:46:38.185815 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:46:38.185815 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 3ec80ef6-338b-4924-98e0-295bcb858dd9 while it is in vm_state rescued Jun 30 10:46:38.185815 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:46:38.185815 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-9df0d13f-7ad7-4b14-ae33-78b79e2fd616 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Returning 409 to user: Cannot 'detach_volume' instance 3ec80ef6-338b-4924-98e0-295bcb858dd9 while it is in vm_state rescued {{(pid=124204) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:46:38.187372 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-9df0d13f-7ad7-4b14-ae33-78b79e2fd616 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "DELETE /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9/os-volume_attachments/a4b931f6-9989-49b8-8842-9b618fb82025" status: 409 len: 152 microversion: 2.1 time: 0.097255 Jun 30 10:46:38.187372 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 359/726] 10.222.0.59 () {58 vars in 1415 bytes} [Thu Jun 30 10:46:38 2022] DELETE /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9/os-volume_attachments/a4b931f6-9989-49b8-8842-9b618fb82025 => generated 152 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 30 10:46:38.192923 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-0ab6d4c0-a41c-4479-984c-1094c9d8889c tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:46:38.193450 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-0ab6d4c0-a41c-4479-984c-1094c9d8889c tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 3ec80ef6-338b-4924-98e0-295bcb858dd9] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:46:38.199384 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0ab6d4c0-a41c-4479-984c-1094c9d8889c tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:46:38.199834 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0ab6d4c0-a41c-4479-984c-1094c9d8889c tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:46:38.200612 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0ab6d4c0-a41c-4479-984c-1094c9d8889c tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:46:38.201045 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0ab6d4c0-a41c-4479-984c-1094c9d8889c tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:46:38.266989 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-0ab6d4c0-a41c-4479-984c-1094c9d8889c tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "POST /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9/action" status: 202 len: 0 microversion: 2.1 time: 0.077702 Jun 30 10:46:38.270498 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 368/727] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Jun 30 10:46:38 2022] POST /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 10:46:38.275705 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-c89e8e14-9a94-45a5-ade3-5479970995e3 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:46:38.276353 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-c89e8e14-9a94-45a5-ade3-5479970995e3 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 3ec80ef6-338b-4924-98e0-295bcb858dd9] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:46:38.282841 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c89e8e14-9a94-45a5-ade3-5479970995e3 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:46:38.283326 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c89e8e14-9a94-45a5-ade3-5479970995e3 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:46:38.284151 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c89e8e14-9a94-45a5-ade3-5479970995e3 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:46:38.284624 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c89e8e14-9a94-45a5-ade3-5479970995e3 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:46:38.416882 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-c89e8e14-9a94-45a5-ade3-5479970995e3 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:46:38.425788 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-c89e8e14-9a94-45a5-ade3-5479970995e3 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9" status: 200 len: 1725 microversion: 2.1 time: 0.153927 Jun 30 10:46:38.426364 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 360/728] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:46:38 2022] GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:46:39.444774 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-9fd1b20e-24a0-4c6c-a0d7-af329c123196 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:46:39.445476 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-9fd1b20e-24a0-4c6c-a0d7-af329c123196 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 3ec80ef6-338b-4924-98e0-295bcb858dd9] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:46:39.451680 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-9fd1b20e-24a0-4c6c-a0d7-af329c123196 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:46:39.452133 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-9fd1b20e-24a0-4c6c-a0d7-af329c123196 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:46:39.452926 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-9fd1b20e-24a0-4c6c-a0d7-af329c123196 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:46:39.453371 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-9fd1b20e-24a0-4c6c-a0d7-af329c123196 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:46:39.580200 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-9fd1b20e-24a0-4c6c-a0d7-af329c123196 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:46:39.588291 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-9fd1b20e-24a0-4c6c-a0d7-af329c123196 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9" status: 200 len: 1725 microversion: 2.1 time: 0.148395 Jun 30 10:46:39.588902 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 369/729] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:46:39 2022] GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:46:40.606126 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-7f1ee3d9-dca7-473d-bdb0-3efbe7f6866e tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:46:40.606667 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-7f1ee3d9-dca7-473d-bdb0-3efbe7f6866e tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 3ec80ef6-338b-4924-98e0-295bcb858dd9] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:46:40.609235 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_api:SELECT=22 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:46:40.614796 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-7f1ee3d9-dca7-473d-bdb0-3efbe7f6866e tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:46:40.615264 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-7f1ee3d9-dca7-473d-bdb0-3efbe7f6866e tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:46:40.616065 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-7f1ee3d9-dca7-473d-bdb0-3efbe7f6866e tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:46:40.616533 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-7f1ee3d9-dca7-473d-bdb0-3efbe7f6866e tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:46:40.743755 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-7f1ee3d9-dca7-473d-bdb0-3efbe7f6866e tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:46:40.752349 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-7f1ee3d9-dca7-473d-bdb0-3efbe7f6866e tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9" status: 200 len: 1725 microversion: 2.1 time: 0.150185 Jun 30 10:46:40.752954 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 361/730] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:46:40 2022] GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:46:41.770032 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-2c5c5bd0-25c6-4c8c-a1b8-0fd361c4804f tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:46:41.770642 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-2c5c5bd0-25c6-4c8c-a1b8-0fd361c4804f tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 3ec80ef6-338b-4924-98e0-295bcb858dd9] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:46:41.776737 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-2c5c5bd0-25c6-4c8c-a1b8-0fd361c4804f tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:46:41.777189 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-2c5c5bd0-25c6-4c8c-a1b8-0fd361c4804f tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:46:41.777944 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-2c5c5bd0-25c6-4c8c-a1b8-0fd361c4804f tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:46:41.778379 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-2c5c5bd0-25c6-4c8c-a1b8-0fd361c4804f tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:46:41.907590 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-2c5c5bd0-25c6-4c8c-a1b8-0fd361c4804f tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:46:41.915828 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-2c5c5bd0-25c6-4c8c-a1b8-0fd361c4804f tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9" status: 200 len: 1725 microversion: 2.1 time: 0.149734 Jun 30 10:46:41.916378 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 370/731] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:46:41 2022] GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:46:42.933134 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-362ce414-802d-4e2f-b0d0-c883ec20a22f tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:46:42.933743 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-362ce414-802d-4e2f-b0d0-c883ec20a22f tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 3ec80ef6-338b-4924-98e0-295bcb858dd9] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:46:42.940990 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-362ce414-802d-4e2f-b0d0-c883ec20a22f tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:46:42.941439 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-362ce414-802d-4e2f-b0d0-c883ec20a22f tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:46:42.942200 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-362ce414-802d-4e2f-b0d0-c883ec20a22f tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:46:42.942638 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-362ce414-802d-4e2f-b0d0-c883ec20a22f tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:46:43.068128 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-362ce414-802d-4e2f-b0d0-c883ec20a22f tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:46:43.076011 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-362ce414-802d-4e2f-b0d0-c883ec20a22f tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9" status: 200 len: 1731 microversion: 2.1 time: 0.146749 Jun 30 10:46:43.076598 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 362/732] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:46:42 2022] GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9 => generated 1731 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:46:43.092786 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-ae948eb2-6bb8-428d-9c94-e335661ba6ea tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:46:43.093271 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-ae948eb2-6bb8-428d-9c94-e335661ba6ea tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 3ec80ef6-338b-4924-98e0-295bcb858dd9] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:46:43.099731 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ae948eb2-6bb8-428d-9c94-e335661ba6ea tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:46:43.100173 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ae948eb2-6bb8-428d-9c94-e335661ba6ea tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:46:43.100956 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ae948eb2-6bb8-428d-9c94-e335661ba6ea tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:46:43.101389 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ae948eb2-6bb8-428d-9c94-e335661ba6ea tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:46:43.183538 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-ae948eb2-6bb8-428d-9c94-e335661ba6ea tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094557 Jun 30 10:46:43.184077 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 371/733] 10.222.0.59 () {58 vars in 1274 bytes} [Thu Jun 30 10:46:43 2022] GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:46:44.075451 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [req-65498ae1-0919-485b-9224-855f41a50d6c req-89369029-dfc5-4cc9-80f1-ec07e5cb4a9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ec80ef6-338b-4924-98e0-295bcb858dd9", "tag": "2f91a1b5-27b0-4bf6-8697-1a3c0ec160b5"}]} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:46:44.083973 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-65498ae1-0919-485b-9224-855f41a50d6c req-89369029-dfc5-4cc9-80f1-ec07e5cb4a9b service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:46:44.084477 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-65498ae1-0919-485b-9224-855f41a50d6c req-89369029-dfc5-4cc9-80f1-ec07e5cb4a9b service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:46:44.095606 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.compute.server_external_events [req-65498ae1-0919-485b-9224-855f41a50d6c req-89369029-dfc5-4cc9-80f1-ec07e5cb4a9b service nova] Creating event network-changed:2f91a1b5-27b0-4bf6-8697-1a3c0ec160b5 for instance 3ec80ef6-338b-4924-98e0-295bcb858dd9 on hv-cinder-82282 Jun 30 10:46:44.100553 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [req-65498ae1-0919-485b-9224-855f41a50d6c req-89369029-dfc5-4cc9-80f1-ec07e5cb4a9b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088841 Jun 30 10:46:44.101138 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 363/734] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:46:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 10:46:46.116562 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [req-e037d6a6-c377-4ebe-92ed-0da84faced84 req-371c470d-1610-4b68-ba83-00ae82177dc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ec80ef6-338b-4924-98e0-295bcb858dd9", "tag": "2f91a1b5-27b0-4bf6-8697-1a3c0ec160b5"}]} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:46:46.125247 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-e037d6a6-c377-4ebe-92ed-0da84faced84 req-371c470d-1610-4b68-ba83-00ae82177dc1 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:46:46.125760 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-e037d6a6-c377-4ebe-92ed-0da84faced84 req-371c470d-1610-4b68-ba83-00ae82177dc1 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:46:46.136723 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.compute.server_external_events [req-e037d6a6-c377-4ebe-92ed-0da84faced84 req-371c470d-1610-4b68-ba83-00ae82177dc1 service nova] Creating event network-changed:2f91a1b5-27b0-4bf6-8697-1a3c0ec160b5 for instance 3ec80ef6-338b-4924-98e0-295bcb858dd9 on hv-cinder-82282 Jun 30 10:46:46.142074 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [req-e037d6a6-c377-4ebe-92ed-0da84faced84 req-371c470d-1610-4b68-ba83-00ae82177dc1 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030520 Jun 30 10:46:46.142701 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 372/735] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:46:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:46:57.033435 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 10:46:57.034025 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Thu Jun 30 10:46:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 10:47:18.770385 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_api:SELECT=5 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:47:18.771126 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_cell1:SELECT=49 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:47:18.775893 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-f7b1a820-b15a-4e7c-9cd9-fee1fc5c3daa tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:47:18.776474 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-f7b1a820-b15a-4e7c-9cd9-fee1fc5c3daa tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:47:18.783934 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f7b1a820-b15a-4e7c-9cd9-fee1fc5c3daa tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:18.784379 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f7b1a820-b15a-4e7c-9cd9-fee1fc5c3daa tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:18.785174 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f7b1a820-b15a-4e7c-9cd9-fee1fc5c3daa tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:18.785611 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f7b1a820-b15a-4e7c-9cd9-fee1fc5c3daa tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:18.864138 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.objects.instance [None req-f7b1a820-b15a-4e7c-9cd9-fee1fc5c3daa tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lazy-loading 'services' on Instance uuid a8379d7c-c539-4cb8-9c06-886aff24e725 {{(pid=124204) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 10:47:18.935255 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-f7b1a820-b15a-4e7c-9cd9-fee1fc5c3daa tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "DELETE /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725/os-volume_attachments/cb618343-7cfc-44ea-b816-5de1f780f126" status: 202 len: 0 microversion: 2.1 time: 0.166374 Jun 30 10:47:18.935858 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 364/736] 10.222.0.59 () {58 vars in 1415 bytes} [Thu Jun 30 10:47:18 2022] DELETE /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725/os-volume_attachments/cb618343-7cfc-44ea-b816-5de1f780f126 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 10:47:20.055332 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-ab1be19f-56f2-4217-9375-193fb10eed59 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:47:20.058514 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_api:SELECT=26 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:47:20.059475 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:47:20.068596 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ab1be19f-56f2-4217-9375-193fb10eed59 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:20.069260 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ab1be19f-56f2-4217-9375-193fb10eed59 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:20.097093 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-ab1be19f-56f2-4217-9375-193fb10eed59 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Going to try to stop instance {{(pid=124203) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 30 10:47:20.136525 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-ab1be19f-56f2-4217-9375-193fb10eed59 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "POST /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725/action" status: 202 len: 0 microversion: 2.1 time: 0.087976 Jun 30 10:47:20.137107 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 373/737] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Jun 30 10:47:20 2022] POST /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 10:47:20.146206 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-49a2761f-f6b8-406d-9236-2a207604f2b9 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:47:20.146965 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-49a2761f-f6b8-406d-9236-2a207604f2b9 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:47:20.154324 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-49a2761f-f6b8-406d-9236-2a207604f2b9 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:20.154800 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-49a2761f-f6b8-406d-9236-2a207604f2b9 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:20.156352 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-49a2761f-f6b8-406d-9236-2a207604f2b9 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:20.156819 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-49a2761f-f6b8-406d-9236-2a207604f2b9 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:20.287853 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-49a2761f-f6b8-406d-9236-2a207604f2b9 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:47:20.295310 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-49a2761f-f6b8-406d-9236-2a207604f2b9 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1677 microversion: 2.1 time: 0.153367 Jun 30 10:47:20.295865 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 365/738] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:47:20 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:47:21.313446 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-d99f1e33-5271-45cc-879c-685e975c330d tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:47:21.314148 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-d99f1e33-5271-45cc-879c-685e975c330d tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:47:21.320286 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-d99f1e33-5271-45cc-879c-685e975c330d tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:21.320774 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-d99f1e33-5271-45cc-879c-685e975c330d tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:21.321538 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-d99f1e33-5271-45cc-879c-685e975c330d tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:21.321974 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-d99f1e33-5271-45cc-879c-685e975c330d tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:21.451646 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-d99f1e33-5271-45cc-879c-685e975c330d tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:47:21.459741 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-d99f1e33-5271-45cc-879c-685e975c330d tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1677 microversion: 2.1 time: 0.150994 Jun 30 10:47:21.460339 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 374/739] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:47:21 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:47:22.477455 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-dfff8340-5da7-452e-a5aa-3829b4b9c3aa tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:47:22.478063 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-dfff8340-5da7-452e-a5aa-3829b4b9c3aa tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:47:22.485172 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-dfff8340-5da7-452e-a5aa-3829b4b9c3aa tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:22.485621 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-dfff8340-5da7-452e-a5aa-3829b4b9c3aa tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:22.486413 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-dfff8340-5da7-452e-a5aa-3829b4b9c3aa tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:22.486847 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-dfff8340-5da7-452e-a5aa-3829b4b9c3aa tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:22.609822 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-dfff8340-5da7-452e-a5aa-3829b4b9c3aa tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:47:22.617254 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-dfff8340-5da7-452e-a5aa-3829b4b9c3aa tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1677 microversion: 2.1 time: 0.143640 Jun 30 10:47:22.617821 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 366/740] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:47:22 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1677 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:47:23.634353 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-a825e710-403d-4d23-abf5-a1ced3775886 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:47:23.634963 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-a825e710-403d-4d23-abf5-a1ced3775886 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:47:23.641563 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a825e710-403d-4d23-abf5-a1ced3775886 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:23.642013 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a825e710-403d-4d23-abf5-a1ced3775886 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:23.642772 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a825e710-403d-4d23-abf5-a1ced3775886 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:23.643213 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a825e710-403d-4d23-abf5-a1ced3775886 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:23.766965 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-a825e710-403d-4d23-abf5-a1ced3775886 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:47:23.774353 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-a825e710-403d-4d23-abf5-a1ced3775886 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1677 microversion: 2.1 time: 0.143878 Jun 30 10:47:23.774906 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 375/741] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:47:23 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1677 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:47:24.792210 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-1a9dfc79-c748-4b59-b68e-d96499b25049 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:47:24.792859 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-1a9dfc79-c748-4b59-b68e-d96499b25049 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:47:24.799340 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1a9dfc79-c748-4b59-b68e-d96499b25049 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:24.799787 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1a9dfc79-c748-4b59-b68e-d96499b25049 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:24.800588 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1a9dfc79-c748-4b59-b68e-d96499b25049 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:24.801023 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1a9dfc79-c748-4b59-b68e-d96499b25049 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:24.931037 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-1a9dfc79-c748-4b59-b68e-d96499b25049 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:47:24.939050 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-1a9dfc79-c748-4b59-b68e-d96499b25049 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1677 microversion: 2.1 time: 0.150837 Jun 30 10:47:24.939616 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 367/742] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:47:24 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:47:25.956559 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-57695a8d-9424-4c19-a77b-db03999c0092 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:47:25.957193 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-57695a8d-9424-4c19-a77b-db03999c0092 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:47:25.963623 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-57695a8d-9424-4c19-a77b-db03999c0092 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:25.964071 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-57695a8d-9424-4c19-a77b-db03999c0092 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:25.964849 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-57695a8d-9424-4c19-a77b-db03999c0092 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:25.965284 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-57695a8d-9424-4c19-a77b-db03999c0092 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:26.090147 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-57695a8d-9424-4c19-a77b-db03999c0092 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:47:26.098175 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-57695a8d-9424-4c19-a77b-db03999c0092 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1677 microversion: 2.1 time: 0.146033 Jun 30 10:47:26.098734 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 376/743] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:47:25 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1677 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:47:27.115594 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-30327f72-5200-4459-b4b6-034d49c01637 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:47:27.116254 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-30327f72-5200-4459-b4b6-034d49c01637 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:47:27.122771 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-30327f72-5200-4459-b4b6-034d49c01637 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:27.123210 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-30327f72-5200-4459-b4b6-034d49c01637 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:27.124009 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-30327f72-5200-4459-b4b6-034d49c01637 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:27.124440 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-30327f72-5200-4459-b4b6-034d49c01637 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:27.253009 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-30327f72-5200-4459-b4b6-034d49c01637 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:47:27.260531 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-30327f72-5200-4459-b4b6-034d49c01637 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1677 microversion: 2.1 time: 0.148826 Jun 30 10:47:27.261111 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 368/744] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:47:27 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:47:27.890157 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-7d60242c-9df9-4fa2-8749-1bcbb3ababef tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:47:27.890694 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-7d60242c-9df9-4fa2-8749-1bcbb3ababef tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:47:27.897106 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-7d60242c-9df9-4fa2-8749-1bcbb3ababef tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:27.897557 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-7d60242c-9df9-4fa2-8749-1bcbb3ababef tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:27.898322 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-7d60242c-9df9-4fa2-8749-1bcbb3ababef tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:27.898762 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-7d60242c-9df9-4fa2-8749-1bcbb3ababef tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:27.928364 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-7d60242c-9df9-4fa2-8749-1bcbb3ababef tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8/os-volume_attachments/6c7f3b00-aa81-4315-9cc9-03fe78ce8ad9" status: 200 len: 194 microversion: 2.20 time: 0.042773 Jun 30 10:47:27.928963 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 377/745] 10.222.0.59 () {60 vars in 1453 bytes} [Thu Jun 30 10:47:27 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8/os-volume_attachments/6c7f3b00-aa81-4315-9cc9-03fe78ce8ad9 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 10:47:27.989734 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-097e1b43-900f-4c19-90e0-c7e37a8ad212 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:47:27.990231 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-097e1b43-900f-4c19-90e0-c7e37a8ad212 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:47:27.996133 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-097e1b43-900f-4c19-90e0-c7e37a8ad212 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:27.996611 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-097e1b43-900f-4c19-90e0-c7e37a8ad212 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:27.997372 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-097e1b43-900f-4c19-90e0-c7e37a8ad212 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:27.997810 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-097e1b43-900f-4c19-90e0-c7e37a8ad212 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:28.075875 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.objects.instance [None req-097e1b43-900f-4c19-90e0-c7e37a8ad212 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lazy-loading 'services' on Instance uuid af0d59b6-8e95-4947-803a-c1d952e218c8 {{(pid=124204) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 10:47:28.146761 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-097e1b43-900f-4c19-90e0-c7e37a8ad212 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "DELETE /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8/os-volume_attachments/6c7f3b00-aa81-4315-9cc9-03fe78ce8ad9" status: 202 len: 0 microversion: 2.20 time: 0.160716 Jun 30 10:47:28.147433 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 369/746] 10.222.0.59 () {60 vars in 1456 bytes} [Thu Jun 30 10:47:27 2022] DELETE /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8/os-volume_attachments/6c7f3b00-aa81-4315-9cc9-03fe78ce8ad9 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 30 10:47:28.155923 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-50fd8c32-8f43-4b07-ae42-c2ad8a1a1908 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:47:28.157270 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-50fd8c32-8f43-4b07-ae42-c2ad8a1a1908 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:47:28.163615 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-50fd8c32-8f43-4b07-ae42-c2ad8a1a1908 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:28.164133 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-50fd8c32-8f43-4b07-ae42-c2ad8a1a1908 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:28.165178 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-50fd8c32-8f43-4b07-ae42-c2ad8a1a1908 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:28.165684 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-50fd8c32-8f43-4b07-ae42-c2ad8a1a1908 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:28.196874 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-50fd8c32-8f43-4b07-ae42-c2ad8a1a1908 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045078 Jun 30 10:47:28.197430 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 378/747] 10.222.0.59 () {60 vars in 1342 bytes} [Thu Jun 30 10:47:28 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 10:47:28.277991 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-ea068210-a1e5-44bb-925d-adb64977eeb2 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:47:28.278688 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-ea068210-a1e5-44bb-925d-adb64977eeb2 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:47:28.284965 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ea068210-a1e5-44bb-925d-adb64977eeb2 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:28.285419 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ea068210-a1e5-44bb-925d-adb64977eeb2 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:28.286177 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ea068210-a1e5-44bb-925d-adb64977eeb2 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:28.286612 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ea068210-a1e5-44bb-925d-adb64977eeb2 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:28.417712 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-ea068210-a1e5-44bb-925d-adb64977eeb2 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:47:28.425913 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-ea068210-a1e5-44bb-925d-adb64977eeb2 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1677 microversion: 2.1 time: 0.152124 Jun 30 10:47:28.426486 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 370/748] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:47:28 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:47:29.208661 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-bc2bfe32-6555-4231-ae3b-c141c23a41e1 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:47:29.209592 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-bc2bfe32-6555-4231-ae3b-c141c23a41e1 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:47:29.216058 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-bc2bfe32-6555-4231-ae3b-c141c23a41e1 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:29.216526 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-bc2bfe32-6555-4231-ae3b-c141c23a41e1 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:29.217290 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-bc2bfe32-6555-4231-ae3b-c141c23a41e1 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:29.217720 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-bc2bfe32-6555-4231-ae3b-c141c23a41e1 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:29.248643 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-bc2bfe32-6555-4231-ae3b-c141c23a41e1 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044031 Jun 30 10:47:29.249197 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 379/749] 10.222.0.59 () {60 vars in 1342 bytes} [Thu Jun 30 10:47:29 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:47:29.305019 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-3c42879f-9749-4abd-a118-fe13d0d67762 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:47:29.305505 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-3c42879f-9749-4abd-a118-fe13d0d67762 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:47:29.312022 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-3c42879f-9749-4abd-a118-fe13d0d67762 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:29.312682 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-3c42879f-9749-4abd-a118-fe13d0d67762 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:29.313440 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-3c42879f-9749-4abd-a118-fe13d0d67762 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:29.313874 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-3c42879f-9749-4abd-a118-fe13d0d67762 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:29.338225 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-3c42879f-9749-4abd-a118-fe13d0d67762 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Going to try to terminate instance {{(pid=124204) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 10:47:29.415599 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-3c42879f-9749-4abd-a118-fe13d0d67762 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "DELETE /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 204 len: 0 microversion: 2.20 time: 0.113903 Jun 30 10:47:29.416287 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 371/750] 10.222.0.59 () {60 vars in 1279 bytes} [Thu Jun 30 10:47:29 2022] DELETE /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 30 10:47:29.426181 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-74043046-5e76-4dd5-89b1-1876e6c49460 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:47:29.426788 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-74043046-5e76-4dd5-89b1-1876e6c49460 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:47:29.432783 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-74043046-5e76-4dd5-89b1-1876e6c49460 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:29.433223 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-74043046-5e76-4dd5-89b1-1876e6c49460 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:29.433981 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-74043046-5e76-4dd5-89b1-1876e6c49460 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:29.434409 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-74043046-5e76-4dd5-89b1-1876e6c49460 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:29.443036 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-7699e631-66bb-475a-a4b3-9d533a528e14 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:47:29.443727 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-7699e631-66bb-475a-a4b3-9d533a528e14 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:47:29.449649 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-7699e631-66bb-475a-a4b3-9d533a528e14 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:29.450099 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-7699e631-66bb-475a-a4b3-9d533a528e14 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:29.450863 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-7699e631-66bb-475a-a4b3-9d533a528e14 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:29.451300 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-7699e631-66bb-475a-a4b3-9d533a528e14 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:29.623714 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-74043046-5e76-4dd5-89b1-1876e6c49460 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:47:29.631756 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-74043046-5e76-4dd5-89b1-1876e6c49460 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:47:29.633174 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-74043046-5e76-4dd5-89b1-1876e6c49460 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:47:29.634327 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-74043046-5e76-4dd5-89b1-1876e6c49460 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1723 microversion: 2.20 time: 0.213541 Jun 30 10:47:29.634463 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-7699e631-66bb-475a-a4b3-9d533a528e14 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:47:29.634886 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 380/751] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:47:29 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1723 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:47:29.642868 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-7699e631-66bb-475a-a4b3-9d533a528e14 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1677 microversion: 2.1 time: 0.203951 Jun 30 10:47:29.643502 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 372/752] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:47:29 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1677 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:47:30.654590 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-7c0d9809-7df0-4d37-b115-78e5b19760e8 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:47:30.655206 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-7c0d9809-7df0-4d37-b115-78e5b19760e8 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:47:30.659548 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-1091e3e3-9ebf-455d-a3be-7e3b53d1b6a8 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:47:30.660155 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-1091e3e3-9ebf-455d-a3be-7e3b53d1b6a8 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:47:30.662408 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-7c0d9809-7df0-4d37-b115-78e5b19760e8 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:30.662862 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-7c0d9809-7df0-4d37-b115-78e5b19760e8 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:30.663632 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-7c0d9809-7df0-4d37-b115-78e5b19760e8 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:30.664067 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-7c0d9809-7df0-4d37-b115-78e5b19760e8 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:30.666712 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1091e3e3-9ebf-455d-a3be-7e3b53d1b6a8 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:30.667162 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1091e3e3-9ebf-455d-a3be-7e3b53d1b6a8 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:30.667920 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1091e3e3-9ebf-455d-a3be-7e3b53d1b6a8 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:30.668357 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1091e3e3-9ebf-455d-a3be-7e3b53d1b6a8 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:30.860928 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-7c0d9809-7df0-4d37-b115-78e5b19760e8 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:47:30.864862 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-1091e3e3-9ebf-455d-a3be-7e3b53d1b6a8 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:47:30.868962 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-7c0d9809-7df0-4d37-b115-78e5b19760e8 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:47:30.870460 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-7c0d9809-7df0-4d37-b115-78e5b19760e8 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:47:30.871614 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-7c0d9809-7df0-4d37-b115-78e5b19760e8 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1723 microversion: 2.20 time: 0.221137 Jun 30 10:47:30.872181 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 381/753] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:47:30 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1723 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:47:30.872777 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-1091e3e3-9ebf-455d-a3be-7e3b53d1b6a8 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1677 microversion: 2.1 time: 0.217319 Jun 30 10:47:30.873405 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 373/754] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:47:30 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1677 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:47:31.889154 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-59b2140e-4661-43c1-97cd-2329d23d6cec tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:47:31.889791 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-59b2140e-4661-43c1-97cd-2329d23d6cec tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:47:31.890665 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-2bc0a3c1-4c63-4ff9-b648-0c55a1172906 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:47:31.892017 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-2bc0a3c1-4c63-4ff9-b648-0c55a1172906 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:47:31.896985 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-59b2140e-4661-43c1-97cd-2329d23d6cec tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:31.897615 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-59b2140e-4661-43c1-97cd-2329d23d6cec tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:31.898400 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-59b2140e-4661-43c1-97cd-2329d23d6cec tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:31.898815 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-59b2140e-4661-43c1-97cd-2329d23d6cec tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:31.899662 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-2bc0a3c1-4c63-4ff9-b648-0c55a1172906 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:31.900294 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-2bc0a3c1-4c63-4ff9-b648-0c55a1172906 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:31.901106 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-2bc0a3c1-4c63-4ff9-b648-0c55a1172906 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:31.901707 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-2bc0a3c1-4c63-4ff9-b648-0c55a1172906 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:31.991091 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-2bc0a3c1-4c63-4ff9-b648-0c55a1172906 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:47:32.000083 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-2bc0a3c1-4c63-4ff9-b648-0c55a1172906 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:47:32.002117 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-2bc0a3c1-4c63-4ff9-b648-0c55a1172906 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:47:32.003139 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-2bc0a3c1-4c63-4ff9-b648-0c55a1172906 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 200 len: 1656 microversion: 2.20 time: 0.117329 Jun 30 10:47:32.004081 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 374/755] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:47:31 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 1656 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 10:47:32.067132 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-59b2140e-4661-43c1-97cd-2329d23d6cec tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:47:32.075819 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-59b2140e-4661-43c1-97cd-2329d23d6cec tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1677 microversion: 2.1 time: 0.190484 Jun 30 10:47:32.079007 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 382/756] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:47:31 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1677 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:47:32.472337 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [req-005beb34-debb-407a-96f8-bf8162e996e0 req-9a03e14c-3ba3-4a8c-a612-987dcce1b3dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af0d59b6-8e95-4947-803a-c1d952e218c8", "name": "network-vif-deleted", "tag": "ec009e37-3070-46e8-8a9a-513065a2c654"}]} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:47:32.481690 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-005beb34-debb-407a-96f8-bf8162e996e0 req-9a03e14c-3ba3-4a8c-a612-987dcce1b3dc service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:32.482397 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-005beb34-debb-407a-96f8-bf8162e996e0 req-9a03e14c-3ba3-4a8c-a612-987dcce1b3dc service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:32.494650 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.compute.server_external_events [req-005beb34-debb-407a-96f8-bf8162e996e0 req-9a03e14c-3ba3-4a8c-a612-987dcce1b3dc service nova] Creating event network-vif-deleted:ec009e37-3070-46e8-8a9a-513065a2c654 for instance af0d59b6-8e95-4947-803a-c1d952e218c8 on hv-cinder-82282 Jun 30 10:47:32.501411 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [req-005beb34-debb-407a-96f8-bf8162e996e0 req-9a03e14c-3ba3-4a8c-a612-987dcce1b3dc service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032701 Jun 30 10:47:32.502148 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 375/757] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:47:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:47:33.023075 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-8f3075ef-7370-40a7-acd8-ae17c9aa6750 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:47:33.024492 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-8f3075ef-7370-40a7-acd8-ae17c9aa6750 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:47:33.032148 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-8f3075ef-7370-40a7-acd8-ae17c9aa6750 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:33.032682 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-8f3075ef-7370-40a7-acd8-ae17c9aa6750 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:33.033726 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-8f3075ef-7370-40a7-acd8-ae17c9aa6750 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:33.034305 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-8f3075ef-7370-40a7-acd8-ae17c9aa6750 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:33.049001 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.wsgi [None req-8f3075ef-7370-40a7-acd8-ae17c9aa6750 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] HTTP exception thrown: Instance af0d59b6-8e95-4947-803a-c1d952e218c8 could not be found. Jun 30 10:47:33.052230 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-8f3075ef-7370-40a7-acd8-ae17c9aa6750 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Request method failure captured: Jun 30 10:47:33.052230 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: request: GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 HTTP/1.1 Jun 30 10:47:33.052230 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Accept: application/json Jun 30 10:47:33.052230 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Accept-Encoding: identity Jun 30 10:47:33.052230 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Connection: close Jun 30 10:47:33.052230 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Content-Length: 0 Jun 30 10:47:33.052230 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Content-Type: application/json Jun 30 10:47:33.052230 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Host: 10.222.0.59 Jun 30 10:47:33.052230 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Openstack-System-Scope: None Jun 30 10:47:33.052230 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: User-Agent: python-urllib3/1.26.9 Jun 30 10:47:33.052230 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Auth-Token: gAAAAABivX2O95PG7OwLZsazVloASqbVmipNAFm6f7qcVY4E3WlX41rd0tnm80pMeaWUbOtnrlH_CSuCdrIaArMqD9imR93SBX_VhBipTNZO_mJ8xWvurtwepIWU8hq9tEB4LqdDH4ZWPwmoyVcMweVJSiWAHLPtJvaEwnl-rQ0OwuRu2pw1LVY Jun 30 10:47:33.052230 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Domain-Id: None Jun 30 10:47:33.052230 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Domain-Name: None Jun 30 10:47:33.052230 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Identity-Status: Confirmed Jun 30 10:47:33.052230 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Is-Admin-Project: True Jun 30 10:47:33.052230 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Openstack-Nova-Api-Version: 2.20 Jun 30 10:47:33.052230 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Domain-Id: default Jun 30 10:47:33.052230 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Domain-Name: Default Jun 30 10:47:33.052230 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Id: 2346c16770124c9a86bc6e30880f8bde Jun 30 10:47:33.052230 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2033035787 Jun 30 10:47:33.052230 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Role: member,reader Jun 30 10:47:33.052230 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Roles: member,reader Jun 30 10:47:33.053672 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/2346c16770124c9a86bc6e30880f8bde"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_2346c16770124c9a86bc6e30880f8bde"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2346c16770124c9a86bc6e30880f8bde"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2346c16770124c9a86bc6e30880f8bde"}]}] Jun 30 10:47:33.053672 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2033035787 Jun 30 10:47:33.053672 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant-Id: 2346c16770124c9a86bc6e30880f8bde Jun 30 10:47:33.053672 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2033035787 Jun 30 10:47:33.053672 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User: tempest-AttachVolumeShelveTestJSON-2033035787-project Jun 30 10:47:33.053672 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Domain-Id: default Jun 30 10:47:33.053672 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Domain-Name: Default Jun 30 10:47:33.053672 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Id: f5003e984d58440a80d98405d187eab0 Jun 30 10:47:33.053672 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2033035787-project Jun 30 10:47:33.053672 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: method: > Jun 30 10:47:33.053672 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: exception: Instance af0d59b6-8e95-4947-803a-c1d952e218c8 could not be found. Jun 30 10:47:33.053672 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: action_args: {'id': 'af0d59b6-8e95-4947-803a-c1d952e218c8'} Jun 30 10:47:33.054459 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:47:33.054459 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:47:33.054459 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 10:47:33.054459 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 10:47:33.054459 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 10:47:33.054459 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 10:47:33.054459 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 10:47:33.054459 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 10:47:33.054459 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 10:47:33.054459 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 10:47:33.054459 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af0d59b6-8e95-4947-803a-c1d952e218c8 could not be found. Jun 30 10:47:33.054459 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:47:33.054459 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:47:33.054459 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:47:33.054459 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:47:33.054459 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:47:33.054459 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:47:33.054459 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:47:33.054459 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:47:33.054459 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:47:33.055667 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:47:33.055667 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 10:47:33.055667 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 10:47:33.055667 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 10:47:33.055667 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 10:47:33.055667 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 10:47:33.055667 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:47:33.055667 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af0d59b6-8e95-4947-803a-c1d952e218c8 could not be found. Jun 30 10:47:33.055667 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:47:33.055667 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:47:33.055667 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:47:33.055667 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:47:33.055667 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:47:33.055667 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:47:33.055667 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:47:33.055667 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:47:33.055667 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af0d59b6-8e95-4947-803a-c1d952e218c8 could not be found. Jun 30 10:47:33.055667 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:47:33.058027 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-8f3075ef-7370-40a7-acd8-ae17c9aa6750 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Returning 404 to user: Instance af0d59b6-8e95-4947-803a-c1d952e218c8 could not be found. {{(pid=124203) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:47:33.059386 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-8f3075ef-7370-40a7-acd8-ae17c9aa6750 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 404 len: 111 microversion: 2.20 time: 0.040969 Jun 30 10:47:33.060055 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 383/758] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:47:33 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 30 10:47:33.073745 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-3fcb0585-b648-4f3b-bae0-3c824e569abc tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '.version_select at 0x7f4dadf37ca0>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:47:33.094792 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-fa577951-3142-4844-b370-8846e704ffc2 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:47:33.095505 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-fa577951-3142-4844-b370-8846e704ffc2 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:47:33.102353 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-3fcb0585-b648-4f3b-bae0-3c824e569abc tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1225802783" status: 204 len: 0 microversion: 2.20 time: 0.036139 Jun 30 10:47:33.102915 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-fa577951-3142-4844-b370-8846e704ffc2 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:33.103370 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-fa577951-3142-4844-b370-8846e704ffc2 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:33.104330 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 376/759] 10.222.0.59 () {60 vars in 1261 bytes} [Thu Jun 30 10:47:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1225802783 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 30 10:47:33.107758 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-fa577951-3142-4844-b370-8846e704ffc2 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:33.108611 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-fa577951-3142-4844-b370-8846e704ffc2 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:33.272107 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-fa577951-3142-4844-b370-8846e704ffc2 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:47:33.282477 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-fa577951-3142-4844-b370-8846e704ffc2 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1677 microversion: 2.1 time: 0.191975 Jun 30 10:47:33.283786 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 384/760] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:47:33 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1677 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:47:34.013566 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-13772fed-ef44-458c-8d29-cdecdc21243e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Action: 'create', calling method: .version_select at 0x7f4dadcc5e50>, body: {"keypair": {"name": "tempest-keypair-671486942", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQ71jYU8R3l6UqAoQuMvWYYxn0BiwCQWfFjLX4LplcZDr5sl6vKawfRUoLBSGN/UFaOdSqVCy2jfPnRmYVSCrD3fFTKgmYqfH+YiLCsxNlv4XTb4BgDWaQCGOSq7Kw/2w=="}} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:47:34.027528 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.quota [None req-13772fed-ef44-458c-8d29-cdecdc21243e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Getting quotas for project 2346c16770124c9a86bc6e30880f8bde. Resources: {'key_pairs'} {{(pid=124204) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 10:47:34.031773 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.quota [None req-13772fed-ef44-458c-8d29-cdecdc21243e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Getting quotas for user f5003e984d58440a80d98405d187eab0 and project 2346c16770124c9a86bc6e30880f8bde. Resources: {'key_pairs'} {{(pid=124204) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 10:47:34.053274 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-13772fed-ef44-458c-8d29-cdecdc21243e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.043604 Jun 30 10:47:34.053858 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 377/761] 10.222.0.59 () {62 vars in 1199 bytes} [Thu Jun 30 10:47:34 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 45 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 30 10:47:34.302720 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-a6ece2c5-a3da-49ba-a4da-36a4b0858d9c tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:47:34.303509 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-a6ece2c5-a3da-49ba-a4da-36a4b0858d9c tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:47:34.310281 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a6ece2c5-a3da-49ba-a4da-36a4b0858d9c tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:34.311026 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a6ece2c5-a3da-49ba-a4da-36a4b0858d9c tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:34.312084 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a6ece2c5-a3da-49ba-a4da-36a4b0858d9c tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:34.312711 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a6ece2c5-a3da-49ba-a4da-36a4b0858d9c tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:34.490798 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-a6ece2c5-a3da-49ba-a4da-36a4b0858d9c tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:47:34.500397 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-a6ece2c5-a3da-49ba-a4da-36a4b0858d9c tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1677 microversion: 2.1 time: 0.203279 Jun 30 10:47:34.501210 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 385/762] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:47:34 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1677 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:47:35.384430 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-21d6d75c-5c23-467b-8024-f975e33e5951 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1889949507", "imageRef": "c473bd04-5a45-4eb7-b6f4-2b5033d4fc1d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7e9d61a2-83fe-4a84-abef-49f52aac027b"}], "security_groups": [{"name": "tempest-securitygroup--132985768"}], "key_name": "tempest-keypair-671486942", "user_data": "}} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:47:35.488818 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.network.neutron [None req-21d6d75c-5c23-467b-8024-f975e33e5951 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] validate_networks() for [('7e9d61a2-83fe-4a84-abef-49f52aac027b', None, None, None, None, None)] {{(pid=124204) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 10:47:35.517941 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-46490a46-d625-424c-91d6-f4da781a479b tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:47:35.518594 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-46490a46-d625-424c-91d6-f4da781a479b tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:47:35.530745 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-46490a46-d625-424c-91d6-f4da781a479b tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:35.531194 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-46490a46-d625-424c-91d6-f4da781a479b tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:35.531963 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-46490a46-d625-424c-91d6-f4da781a479b tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:35.532402 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-46490a46-d625-424c-91d6-f4da781a479b tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:35.730232 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-46490a46-d625-424c-91d6-f4da781a479b tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:47:35.738155 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-46490a46-d625-424c-91d6-f4da781a479b tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1677 microversion: 2.1 time: 0.224620 Jun 30 10:47:35.738822 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 386/763] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:47:35 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1677 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:47:35.922368 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.virt.hardware [None req-21d6d75c-5c23-467b-8024-f975e33e5951 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Flavor limits 0:0:0 {{(pid=124204) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 10:47:35.922789 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.virt.hardware [None req-21d6d75c-5c23-467b-8024-f975e33e5951 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Image limits 0:0:0 {{(pid=124204) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 10:47:35.923262 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.virt.hardware [None req-21d6d75c-5c23-467b-8024-f975e33e5951 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Flavor pref 0:0:0 {{(pid=124204) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 10:47:35.923670 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.virt.hardware [None req-21d6d75c-5c23-467b-8024-f975e33e5951 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Image pref 0:0:0 {{(pid=124204) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 10:47:35.924077 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.virt.hardware [None req-21d6d75c-5c23-467b-8024-f975e33e5951 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124204) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 10:47:35.933450 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-21d6d75c-5c23-467b-8024-f975e33e5951 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:35.933893 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-21d6d75c-5c23-467b-8024-f975e33e5951 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:35.934683 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-21d6d75c-5c23-467b-8024-f975e33e5951 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:35.935121 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-21d6d75c-5c23-467b-8024-f975e33e5951 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:35.951653 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.quota [None req-21d6d75c-5c23-467b-8024-f975e33e5951 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Getting quotas for project 2346c16770124c9a86bc6e30880f8bde. Resources: {'instances', 'cores', 'ram'} {{(pid=124204) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 10:47:35.956129 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.quota [None req-21d6d75c-5c23-467b-8024-f975e33e5951 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Getting quotas for user f5003e984d58440a80d98405d187eab0 and project 2346c16770124c9a86bc6e30880f8bde. Resources: {'instances', 'cores', 'ram'} {{(pid=124204) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 10:47:35.966953 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-21d6d75c-5c23-467b-8024-f975e33e5951 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Going to run 1 instances... {{(pid=124204) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 10:47:35.969335 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-21d6d75c-5c23-467b-8024-f975e33e5951 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c473bd04-5a45-4eb7-b6f4-2b5033d4fc1d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124204) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 10:47:36.014919 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-21d6d75c-5c23-467b-8024-f975e33e5951 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.635443 Jun 30 10:47:36.016205 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 378/764] 10.222.0.59 () {62 vars in 1187 bytes} [Thu Jun 30 10:47:35 2022] POST /compute/v2.1/servers => generated 401 bytes in 637 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 30 10:47:36.026250 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-74c1b063-c1cb-4b5c-be92-fb45a7c29c82 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:47:36.026855 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-74c1b063-c1cb-4b5c-be92-fb45a7c29c82 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:47:36.087759 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-74c1b063-c1cb-4b5c-be92-fb45a7c29c82 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:47:36.094878 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-74c1b063-c1cb-4b5c-be92-fb45a7c29c82 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:47:36.096366 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-74c1b063-c1cb-4b5c-be92-fb45a7c29c82 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:47:36.097493 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-74c1b063-c1cb-4b5c-be92-fb45a7c29c82 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224" status: 200 len: 1281 microversion: 2.20 time: 0.075117 Jun 30 10:47:36.098042 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 387/765] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:47:36 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 => generated 1281 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:47:36.755389 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-d8f507c6-64f6-4c5a-ba47-9baf2faee571 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:47:36.756036 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-d8f507c6-64f6-4c5a-ba47-9baf2faee571 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:47:36.763333 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d8f507c6-64f6-4c5a-ba47-9baf2faee571 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:36.763779 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d8f507c6-64f6-4c5a-ba47-9baf2faee571 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:36.764565 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d8f507c6-64f6-4c5a-ba47-9baf2faee571 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:36.765000 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d8f507c6-64f6-4c5a-ba47-9baf2faee571 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:36.891609 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-d8f507c6-64f6-4c5a-ba47-9baf2faee571 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:47:36.899791 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-d8f507c6-64f6-4c5a-ba47-9baf2faee571 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1677 microversion: 2.1 time: 0.148089 Jun 30 10:47:36.900698 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 379/766] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:47:36 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:47:37.115309 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-e7f5bded-429d-49b9-915b-82562029d1c8 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:47:37.116082 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-e7f5bded-429d-49b9-915b-82562029d1c8 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:47:37.124127 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e7f5bded-429d-49b9-915b-82562029d1c8 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:37.124617 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e7f5bded-429d-49b9-915b-82562029d1c8 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:37.125482 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e7f5bded-429d-49b9-915b-82562029d1c8 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:37.125921 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e7f5bded-429d-49b9-915b-82562029d1c8 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:37.185861 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-e7f5bded-429d-49b9-915b-82562029d1c8 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:47:37.193853 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-e7f5bded-429d-49b9-915b-82562029d1c8 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:47:37.195409 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-e7f5bded-429d-49b9-915b-82562029d1c8 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:47:37.196558 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-e7f5bded-429d-49b9-915b-82562029d1c8 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224" status: 200 len: 1339 microversion: 2.20 time: 0.085315 Jun 30 10:47:37.197124 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 388/767] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:47:37 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 => generated 1339 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:47:37.917834 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-0b6ac229-a185-47b0-8ecd-64a2f22e0bde tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:47:37.918378 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-0b6ac229-a185-47b0-8ecd-64a2f22e0bde tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:47:37.925043 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-0b6ac229-a185-47b0-8ecd-64a2f22e0bde tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:37.925473 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-0b6ac229-a185-47b0-8ecd-64a2f22e0bde tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:37.926231 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-0b6ac229-a185-47b0-8ecd-64a2f22e0bde tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:37.926663 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-0b6ac229-a185-47b0-8ecd-64a2f22e0bde tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:38.063149 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-0b6ac229-a185-47b0-8ecd-64a2f22e0bde tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:47:38.066888 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:47:38.072928 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-0b6ac229-a185-47b0-8ecd-64a2f22e0bde tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1677 microversion: 2.1 time: 0.158872 Jun 30 10:47:38.073505 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 380/768] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:47:37 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:47:38.215069 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-fc3cd1d7-6e93-47b0-9d90-1dfb5d6af2df tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:47:38.216718 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-fc3cd1d7-6e93-47b0-9d90-1dfb5d6af2df tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:47:38.224574 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-fc3cd1d7-6e93-47b0-9d90-1dfb5d6af2df tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:38.225159 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-fc3cd1d7-6e93-47b0-9d90-1dfb5d6af2df tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:38.226091 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-fc3cd1d7-6e93-47b0-9d90-1dfb5d6af2df tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:38.226748 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-fc3cd1d7-6e93-47b0-9d90-1dfb5d6af2df tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:38.333182 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [req-2f7c9c1e-392e-45f5-bee9-698830b6be71 req-a3afd2cf-faa3-4bba-b866-e5cade8c7377 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a6b5e16-473d-4317-8bf7-ee0df07cb224", "tag": "616d9e47-3706-4db1-a51a-9e45603ab16c"}]} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:47:38.347758 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-2f7c9c1e-392e-45f5-bee9-698830b6be71 req-a3afd2cf-faa3-4bba-b866-e5cade8c7377 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:38.348437 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-2f7c9c1e-392e-45f5-bee9-698830b6be71 req-a3afd2cf-faa3-4bba-b866-e5cade8c7377 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:38.365865 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.compute.server_external_events [req-2f7c9c1e-392e-45f5-bee9-698830b6be71 req-a3afd2cf-faa3-4bba-b866-e5cade8c7377 service nova] Creating event network-changed:616d9e47-3706-4db1-a51a-9e45603ab16c for instance 7a6b5e16-473d-4317-8bf7-ee0df07cb224 on hv-cinder-82282 Jun 30 10:47:38.374777 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [req-2f7c9c1e-392e-45f5-bee9-698830b6be71 req-a3afd2cf-faa3-4bba-b866-e5cade8c7377 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047885 Jun 30 10:47:38.375404 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 381/769] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:47:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:47:38.414831 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-fc3cd1d7-6e93-47b0-9d90-1dfb5d6af2df tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:47:38.424136 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-fc3cd1d7-6e93-47b0-9d90-1dfb5d6af2df tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:47:38.425803 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-fc3cd1d7-6e93-47b0-9d90-1dfb5d6af2df tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:47:38.427092 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-fc3cd1d7-6e93-47b0-9d90-1dfb5d6af2df tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224" status: 200 len: 1406 microversion: 2.20 time: 0.215908 Jun 30 10:47:38.427730 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 389/770] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:47:38 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 => generated 1406 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 10:47:39.090934 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-1058e419-7ad5-4b07-8a67-1cc68a667b30 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:47:39.091651 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-1058e419-7ad5-4b07-8a67-1cc68a667b30 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:47:39.098423 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1058e419-7ad5-4b07-8a67-1cc68a667b30 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:39.098868 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1058e419-7ad5-4b07-8a67-1cc68a667b30 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:39.099625 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1058e419-7ad5-4b07-8a67-1cc68a667b30 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:39.100058 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1058e419-7ad5-4b07-8a67-1cc68a667b30 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:39.229060 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-1058e419-7ad5-4b07-8a67-1cc68a667b30 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:47:39.236793 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-1058e419-7ad5-4b07-8a67-1cc68a667b30 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1677 microversion: 2.1 time: 0.150283 Jun 30 10:47:39.237363 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 382/771] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:47:39 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:47:39.445258 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-092e8b7f-a7f5-4303-8c6c-e0d1e55693b8 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:47:39.445804 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-092e8b7f-a7f5-4303-8c6c-e0d1e55693b8 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:47:39.452194 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-092e8b7f-a7f5-4303-8c6c-e0d1e55693b8 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:39.452722 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-092e8b7f-a7f5-4303-8c6c-e0d1e55693b8 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:39.453478 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-092e8b7f-a7f5-4303-8c6c-e0d1e55693b8 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:39.453907 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-092e8b7f-a7f5-4303-8c6c-e0d1e55693b8 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:39.457829 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:47:39.581950 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-092e8b7f-a7f5-4303-8c6c-e0d1e55693b8 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:47:39.589882 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-092e8b7f-a7f5-4303-8c6c-e0d1e55693b8 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:47:39.591358 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-092e8b7f-a7f5-4303-8c6c-e0d1e55693b8 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:47:39.592451 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-092e8b7f-a7f5-4303-8c6c-e0d1e55693b8 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224" status: 200 len: 1406 microversion: 2.20 time: 0.151194 Jun 30 10:47:39.593026 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 390/772] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:47:39 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:47:40.253932 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-fe00e2cd-44c4-4b4c-82ad-ae5c510d917c tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:47:40.254538 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-fe00e2cd-44c4-4b4c-82ad-ae5c510d917c tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:47:40.261470 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-fe00e2cd-44c4-4b4c-82ad-ae5c510d917c tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:40.261913 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-fe00e2cd-44c4-4b4c-82ad-ae5c510d917c tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:40.262673 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-fe00e2cd-44c4-4b4c-82ad-ae5c510d917c tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:40.263102 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-fe00e2cd-44c4-4b4c-82ad-ae5c510d917c tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:40.386854 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-fe00e2cd-44c4-4b4c-82ad-ae5c510d917c tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:47:40.394864 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-fe00e2cd-44c4-4b4c-82ad-ae5c510d917c tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1677 microversion: 2.1 time: 0.145114 Jun 30 10:47:40.395436 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 383/773] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:47:40 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1677 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:47:40.609941 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-f72658c2-bb3e-4aaa-9252-9fdd96bb5d50 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:47:40.610468 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-f72658c2-bb3e-4aaa-9252-9fdd96bb5d50 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:47:40.616297 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-f72658c2-bb3e-4aaa-9252-9fdd96bb5d50 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:40.616765 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-f72658c2-bb3e-4aaa-9252-9fdd96bb5d50 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:40.617515 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-f72658c2-bb3e-4aaa-9252-9fdd96bb5d50 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:40.617946 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-f72658c2-bb3e-4aaa-9252-9fdd96bb5d50 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:40.744290 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-f72658c2-bb3e-4aaa-9252-9fdd96bb5d50 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:47:40.752584 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-f72658c2-bb3e-4aaa-9252-9fdd96bb5d50 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:47:40.754074 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-f72658c2-bb3e-4aaa-9252-9fdd96bb5d50 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:47:40.755172 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-f72658c2-bb3e-4aaa-9252-9fdd96bb5d50 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224" status: 200 len: 1406 microversion: 2.20 time: 0.149655 Jun 30 10:47:40.755724 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 391/774] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:47:40 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 => generated 1406 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:47:41.412032 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-73afa50f-a833-468c-822f-9abc5348b98d tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:47:41.412683 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-73afa50f-a833-468c-822f-9abc5348b98d tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:47:41.419154 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-73afa50f-a833-468c-822f-9abc5348b98d tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:41.419611 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-73afa50f-a833-468c-822f-9abc5348b98d tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:41.420372 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-73afa50f-a833-468c-822f-9abc5348b98d tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:41.420836 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-73afa50f-a833-468c-822f-9abc5348b98d tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:41.547024 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-73afa50f-a833-468c-822f-9abc5348b98d tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:47:41.554792 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-73afa50f-a833-468c-822f-9abc5348b98d tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1677 microversion: 2.1 time: 0.146566 Jun 30 10:47:41.555709 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 384/775] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:47:41 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:47:41.773638 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-9ebd494b-9610-4ab9-ae29-0fc72a4da260 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:47:41.774360 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-9ebd494b-9610-4ab9-ae29-0fc72a4da260 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:47:41.781700 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-9ebd494b-9610-4ab9-ae29-0fc72a4da260 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:41.782154 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-9ebd494b-9610-4ab9-ae29-0fc72a4da260 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:41.782934 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-9ebd494b-9610-4ab9-ae29-0fc72a4da260 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:41.783374 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-9ebd494b-9610-4ab9-ae29-0fc72a4da260 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:41.914377 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-9ebd494b-9610-4ab9-ae29-0fc72a4da260 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:47:41.922245 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-9ebd494b-9610-4ab9-ae29-0fc72a4da260 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:47:41.923718 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-9ebd494b-9610-4ab9-ae29-0fc72a4da260 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:47:41.924832 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-9ebd494b-9610-4ab9-ae29-0fc72a4da260 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224" status: 200 len: 1406 microversion: 2.20 time: 0.155093 Jun 30 10:47:41.925397 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 392/776] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:47:41 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:47:42.571268 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-9d560fc0-625c-4cb3-920f-f526f8d3a3b5 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:47:42.571814 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-9d560fc0-625c-4cb3-920f-f526f8d3a3b5 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:47:42.578308 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-9d560fc0-625c-4cb3-920f-f526f8d3a3b5 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:42.578756 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-9d560fc0-625c-4cb3-920f-f526f8d3a3b5 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:42.579549 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-9d560fc0-625c-4cb3-920f-f526f8d3a3b5 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:42.579985 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-9d560fc0-625c-4cb3-920f-f526f8d3a3b5 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:42.705583 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-9d560fc0-625c-4cb3-920f-f526f8d3a3b5 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:47:42.713085 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-9d560fc0-625c-4cb3-920f-f526f8d3a3b5 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1654 microversion: 2.1 time: 0.145762 Jun 30 10:47:42.713663 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 385/777] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:47:42 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1654 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:47:42.729597 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-59ba9d8a-f0d8-479c-b8d1-bd61a1052e93 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:47:42.736429 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-59ba9d8a-f0d8-479c-b8d1-bd61a1052e93 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:42.736913 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-59ba9d8a-f0d8-479c-b8d1-bd61a1052e93 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:42.757641 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-59ba9d8a-f0d8-479c-b8d1-bd61a1052e93 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Going to try to start instance {{(pid=124203) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 30 10:47:42.798759 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-59ba9d8a-f0d8-479c-b8d1-bd61a1052e93 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "POST /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725/action" status: 202 len: 0 microversion: 2.1 time: 0.072809 Jun 30 10:47:42.799512 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 393/778] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Jun 30 10:47:42 2022] POST /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725/action => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 10:47:42.808144 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-930096d3-e4db-44b4-8d74-e96c12366825 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:47:42.808783 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-930096d3-e4db-44b4-8d74-e96c12366825 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:47:42.821727 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-930096d3-e4db-44b4-8d74-e96c12366825 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:42.822080 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-930096d3-e4db-44b4-8d74-e96c12366825 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:42.823517 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-930096d3-e4db-44b4-8d74-e96c12366825 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:42.824288 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-930096d3-e4db-44b4-8d74-e96c12366825 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:42.944533 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-a0f11057-a411-45f5-8693-9c8a20a7b913 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:47:42.945240 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-a0f11057-a411-45f5-8693-9c8a20a7b913 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:47:42.951780 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a0f11057-a411-45f5-8693-9c8a20a7b913 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:42.952920 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a0f11057-a411-45f5-8693-9c8a20a7b913 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:42.953725 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a0f11057-a411-45f5-8693-9c8a20a7b913 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:42.954164 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a0f11057-a411-45f5-8693-9c8a20a7b913 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:42.962660 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-930096d3-e4db-44b4-8d74-e96c12366825 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:47:42.970930 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-930096d3-e4db-44b4-8d74-e96c12366825 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1663 microversion: 2.1 time: 0.166624 Jun 30 10:47:42.971726 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 386/779] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:47:42 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1663 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:47:43.086270 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-a0f11057-a411-45f5-8693-9c8a20a7b913 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:47:43.095378 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-a0f11057-a411-45f5-8693-9c8a20a7b913 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:47:43.096912 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-a0f11057-a411-45f5-8693-9c8a20a7b913 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:47:43.098035 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-a0f11057-a411-45f5-8693-9c8a20a7b913 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224" status: 200 len: 1406 microversion: 2.20 time: 0.158957 Jun 30 10:47:43.098597 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 394/780] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:47:42 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 10:47:43.987939 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-5eeea133-068d-42bb-9b9b-f1297e719138 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:47:43.988587 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-5eeea133-068d-42bb-9b9b-f1297e719138 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:47:43.995083 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5eeea133-068d-42bb-9b9b-f1297e719138 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:43.995530 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5eeea133-068d-42bb-9b9b-f1297e719138 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:43.996286 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5eeea133-068d-42bb-9b9b-f1297e719138 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:43.996744 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5eeea133-068d-42bb-9b9b-f1297e719138 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:44.116069 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-96d9be20-6a15-4429-9774-9bf583b008ed tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:47:44.116689 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-96d9be20-6a15-4429-9774-9bf583b008ed tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:47:44.123734 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-96d9be20-6a15-4429-9774-9bf583b008ed tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:44.124189 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-96d9be20-6a15-4429-9774-9bf583b008ed tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:44.125687 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-96d9be20-6a15-4429-9774-9bf583b008ed tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:44.126130 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-96d9be20-6a15-4429-9774-9bf583b008ed tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:44.127836 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-5eeea133-068d-42bb-9b9b-f1297e719138 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:47:44.136286 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-5eeea133-068d-42bb-9b9b-f1297e719138 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1663 microversion: 2.1 time: 0.152668 Jun 30 10:47:44.137337 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 387/781] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:47:43 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1663 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:47:44.191116 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-94bc5442-c547-4932-99d8-800b57c18928 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:47:44.192101 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-94bc5442-c547-4932-99d8-800b57c18928 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: b4ed536b-47ac-4405-a11b-e2ed38021db3] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:47:44.198318 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-94bc5442-c547-4932-99d8-800b57c18928 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:44.199442 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-94bc5442-c547-4932-99d8-800b57c18928 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:44.200315 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-94bc5442-c547-4932-99d8-800b57c18928 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:44.200913 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-94bc5442-c547-4932-99d8-800b57c18928 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:44.227060 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-94bc5442-c547-4932-99d8-800b57c18928 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/b4ed536b-47ac-4405-a11b-e2ed38021db3/ips" status: 200 len: 149 microversion: 2.1 time: 0.039870 Jun 30 10:47:44.227948 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 388/782] 10.222.0.59 () {58 vars in 1247 bytes} [Thu Jun 30 10:47:44 2022] GET /compute/v2.1/servers/b4ed536b-47ac-4405-a11b-e2ed38021db3/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 10:47:44.239370 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-771836e7-692d-4b41-b116-3e9c0a26d366 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5895ff83-fbfd-4109-8737-162608139595"}} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:47:44.240452 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-771836e7-692d-4b41-b116-3e9c0a26d366 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: b4ed536b-47ac-4405-a11b-e2ed38021db3] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:47:44.247067 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-771836e7-692d-4b41-b116-3e9c0a26d366 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:44.247525 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-771836e7-692d-4b41-b116-3e9c0a26d366 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:44.248320 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-771836e7-692d-4b41-b116-3e9c0a26d366 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:44.248799 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-771836e7-692d-4b41-b116-3e9c0a26d366 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:44.271536 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-96d9be20-6a15-4429-9774-9bf583b008ed tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:47:44.283193 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-96d9be20-6a15-4429-9774-9bf583b008ed tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:47:44.284877 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-96d9be20-6a15-4429-9774-9bf583b008ed tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:47:44.286247 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-96d9be20-6a15-4429-9774-9bf583b008ed tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224" status: 200 len: 1406 microversion: 2.20 time: 0.174524 Jun 30 10:47:44.286803 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 395/783] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:47:44 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 10:47:44.354112 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.wsgi [None req-771836e7-692d-4b41-b116-3e9c0a26d366 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] HTTP exception thrown: Invalid volume: volume 5895ff83-fbfd-4109-8737-162608139595 is already attached to instances: 6bc2024c-c05e-4409-a142-e8cf3191a203 Jun 30 10:47:44.356121 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-771836e7-692d-4b41-b116-3e9c0a26d366 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Request method failure captured: Jun 30 10:47:44.356121 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: request: POST /compute/v2.1/servers/b4ed536b-47ac-4405-a11b-e2ed38021db3/os-volume_attachments HTTP/1.1 Jun 30 10:47:44.356121 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Accept: application/json Jun 30 10:47:44.356121 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Accept-Encoding: identity Jun 30 10:47:44.356121 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Connection: close Jun 30 10:47:44.356121 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Content-Length: 74 Jun 30 10:47:44.356121 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Content-Type: application/json Jun 30 10:47:44.356121 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Host: 10.222.0.59 Jun 30 10:47:44.356121 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Openstack-System-Scope: None Jun 30 10:47:44.356121 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: User-Agent: python-urllib3/1.26.9 Jun 30 10:47:44.356121 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Auth-Token: gAAAAABivX2SDXLzZddWIKNVN1nlKFPwtYJlUUF8PxnvIHmdlvz3CWxsmmlutMh4nwIcp8e29jVTyW0L2PeVImDMIlnOZ-7kokNBpPBYwuv_h-8Q51jKjjG2cB0Se9mEglmc0BxaTnOJa9GnDeBKjS31T1Z6kscoN_FtN_Ly_k2htqmUscjC_wQ Jun 30 10:47:44.356121 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Domain-Id: None Jun 30 10:47:44.356121 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Domain-Name: None Jun 30 10:47:44.356121 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Identity-Status: Confirmed Jun 30 10:47:44.356121 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Is-Admin-Project: True Jun 30 10:47:44.356121 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Domain-Id: default Jun 30 10:47:44.356121 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Domain-Name: Default Jun 30 10:47:44.356121 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Id: 848d69e5041341488aafc3e6d26d491c Jun 30 10:47:44.356121 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Name: tempest-AttachVolumeNegativeTest-1311706498 Jun 30 10:47:44.356121 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Role: member,reader Jun 30 10:47:44.356121 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Roles: member,reader Jun 30 10:47:44.357928 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/848d69e5041341488aafc3e6d26d491c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_848d69e5041341488aafc3e6d26d491c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/848d69e5041341488aafc3e6d26d491c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/848d69e5041341488aafc3e6d26d491c"}]}] Jun 30 10:47:44.357928 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant: tempest-AttachVolumeNegativeTest-1311706498 Jun 30 10:47:44.357928 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant-Id: 848d69e5041341488aafc3e6d26d491c Jun 30 10:47:44.357928 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1311706498 Jun 30 10:47:44.357928 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User: tempest-AttachVolumeNegativeTest-1311706498-project Jun 30 10:47:44.357928 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Domain-Id: default Jun 30 10:47:44.357928 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Domain-Name: Default Jun 30 10:47:44.357928 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Id: d6a194d68415422fbc6ca75a8dbccf22 Jun 30 10:47:44.357928 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Name: tempest-AttachVolumeNegativeTest-1311706498-project Jun 30 10:47:44.357928 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Jun 30 10:47:44.357928 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: {"volumeAttachment": {"volumeId": "5895ff83-fbfd-4109-8737-162608139595"}} Jun 30 10:47:44.357928 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: method: > Jun 30 10:47:44.359583 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: exception: Invalid volume: volume 5895ff83-fbfd-4109-8737-162608139595 is already attached to instances: 6bc2024c-c05e-4409-a142-e8cf3191a203 Jun 30 10:47:44.359583 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: action_args: {'server_id': 'b4ed536b-47ac-4405-a11b-e2ed38021db3', 'body': {'volumeAttachment': {'volumeId': '5895ff83-fbfd-4109-8737-162608139595'}}} Jun 30 10:47:44.359583 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:47:44.359583 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:47:44.359583 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 30 10:47:44.359583 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 30 10:47:44.359583 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 30 10:47:44.359583 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 30 10:47:44.359583 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 30 10:47:44.359583 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 30 10:47:44.359583 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 30 10:47:44.359583 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 30 10:47:44.359583 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 30 10:47:44.359583 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 30 10:47:44.359583 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 5895ff83-fbfd-4109-8737-162608139595 is already attached to instances: 6bc2024c-c05e-4409-a142-e8cf3191a203 Jun 30 10:47:44.359583 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:47:44.359583 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:47:44.359583 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:47:44.359583 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:47:44.361091 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:47:44.361091 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:47:44.361091 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:47:44.361091 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:47:44.361091 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:47:44.361091 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:47:44.361091 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 30 10:47:44.361091 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 10:47:44.361091 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 30 10:47:44.361091 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 10:47:44.361091 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 30 10:47:44.361091 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 10:47:44.361091 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 30 10:47:44.361091 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 30 10:47:44.361091 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 5895ff83-fbfd-4109-8737-162608139595 is already attached to instances: 6bc2024c-c05e-4409-a142-e8cf3191a203 Jun 30 10:47:44.361091 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:47:44.361091 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:47:44.361091 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:47:44.361091 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:47:44.361091 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:47:44.362621 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:47:44.362621 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:47:44.362621 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:47:44.362621 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 5895ff83-fbfd-4109-8737-162608139595 is already attached to instances: 6bc2024c-c05e-4409-a142-e8cf3191a203 Jun 30 10:47:44.362621 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:47:44.362621 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-771836e7-692d-4b41-b116-3e9c0a26d366 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Returning 400 to user: Invalid volume: volume 5895ff83-fbfd-4109-8737-162608139595 is already attached to instances: 6bc2024c-c05e-4409-a142-e8cf3191a203 {{(pid=124204) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:47:44.362621 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-771836e7-692d-4b41-b116-3e9c0a26d366 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "POST /compute/v2.1/servers/b4ed536b-47ac-4405-a11b-e2ed38021db3/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.122483 Jun 30 10:47:44.362621 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 389/784] 10.222.0.59 () {60 vars in 1322 bytes} [Thu Jun 30 10:47:44 2022] POST /compute/v2.1/servers/b4ed536b-47ac-4405-a11b-e2ed38021db3/os-volume_attachments => generated 174 bytes in 124 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 30 10:47:44.367180 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-56879cfc-defd-4bb8-9d4b-4dfc2b7173e7 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:47:44.367706 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-56879cfc-defd-4bb8-9d4b-4dfc2b7173e7 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: b4ed536b-47ac-4405-a11b-e2ed38021db3] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:47:44.374048 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-56879cfc-defd-4bb8-9d4b-4dfc2b7173e7 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:44.374457 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-56879cfc-defd-4bb8-9d4b-4dfc2b7173e7 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:44.375211 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-56879cfc-defd-4bb8-9d4b-4dfc2b7173e7 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:44.375642 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-56879cfc-defd-4bb8-9d4b-4dfc2b7173e7 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:44.399451 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-56879cfc-defd-4bb8-9d4b-4dfc2b7173e7 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: b4ed536b-47ac-4405-a11b-e2ed38021db3] Going to try to terminate instance {{(pid=124203) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 10:47:44.470596 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-56879cfc-defd-4bb8-9d4b-4dfc2b7173e7 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "DELETE /compute/v2.1/servers/b4ed536b-47ac-4405-a11b-e2ed38021db3" status: 204 len: 0 microversion: 2.1 time: 0.106937 Jun 30 10:47:44.471295 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 396/785] 10.222.0.59 () {58 vars in 1238 bytes} [Thu Jun 30 10:47:44 2022] DELETE /compute/v2.1/servers/b4ed536b-47ac-4405-a11b-e2ed38021db3 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 10:47:44.479734 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-9f508bcd-250f-44b8-b008-69b32f8ecac2 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:47:44.480354 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-9f508bcd-250f-44b8-b008-69b32f8ecac2 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: b4ed536b-47ac-4405-a11b-e2ed38021db3] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:47:44.488026 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-9f508bcd-250f-44b8-b008-69b32f8ecac2 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:44.488472 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-9f508bcd-250f-44b8-b008-69b32f8ecac2 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:44.489276 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-9f508bcd-250f-44b8-b008-69b32f8ecac2 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:44.489760 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-9f508bcd-250f-44b8-b008-69b32f8ecac2 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:44.614229 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-9f508bcd-250f-44b8-b008-69b32f8ecac2 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:47:44.621626 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-9f508bcd-250f-44b8-b008-69b32f8ecac2 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/b4ed536b-47ac-4405-a11b-e2ed38021db3" status: 200 len: 1679 microversion: 2.1 time: 0.145728 Jun 30 10:47:44.622182 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 390/786] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:47:44 2022] GET /compute/v2.1/servers/b4ed536b-47ac-4405-a11b-e2ed38021db3 => generated 1679 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:47:45.153797 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-fa4e2bb3-2345-4ea3-9ca1-e43170a89d25 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:47:45.154410 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-fa4e2bb3-2345-4ea3-9ca1-e43170a89d25 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:47:45.160865 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-fa4e2bb3-2345-4ea3-9ca1-e43170a89d25 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:45.161319 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-fa4e2bb3-2345-4ea3-9ca1-e43170a89d25 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:45.162111 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-fa4e2bb3-2345-4ea3-9ca1-e43170a89d25 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:45.162557 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-fa4e2bb3-2345-4ea3-9ca1-e43170a89d25 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:45.291940 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-fa4e2bb3-2345-4ea3-9ca1-e43170a89d25 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:47:45.299933 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-fa4e2bb3-2345-4ea3-9ca1-e43170a89d25 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1667 microversion: 2.1 time: 0.150419 Jun 30 10:47:45.300578 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 397/787] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:47:45 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1667 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:47:45.305090 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-769738eb-32f7-4bd6-884d-cee9b65aac2d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:47:45.305708 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-769738eb-32f7-4bd6-884d-cee9b65aac2d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:47:45.313430 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-769738eb-32f7-4bd6-884d-cee9b65aac2d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:45.313886 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-769738eb-32f7-4bd6-884d-cee9b65aac2d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:45.314657 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-769738eb-32f7-4bd6-884d-cee9b65aac2d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:45.315092 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-769738eb-32f7-4bd6-884d-cee9b65aac2d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:45.440704 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-769738eb-32f7-4bd6-884d-cee9b65aac2d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:47:45.448597 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-769738eb-32f7-4bd6-884d-cee9b65aac2d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:47:45.450115 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-769738eb-32f7-4bd6-884d-cee9b65aac2d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:47:45.451198 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-769738eb-32f7-4bd6-884d-cee9b65aac2d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224" status: 200 len: 1406 microversion: 2.20 time: 0.150015 Jun 30 10:47:45.451753 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 391/788] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:47:45 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 => generated 1406 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 10:47:45.638923 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-38fce7a6-b2d1-4d4e-946c-ebf1c6d32019 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:47:45.639540 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-38fce7a6-b2d1-4d4e-946c-ebf1c6d32019 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: b4ed536b-47ac-4405-a11b-e2ed38021db3] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:47:45.645641 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-38fce7a6-b2d1-4d4e-946c-ebf1c6d32019 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:45.646091 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-38fce7a6-b2d1-4d4e-946c-ebf1c6d32019 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:45.646854 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-38fce7a6-b2d1-4d4e-946c-ebf1c6d32019 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:45.647317 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-38fce7a6-b2d1-4d4e-946c-ebf1c6d32019 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:45.770864 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-38fce7a6-b2d1-4d4e-946c-ebf1c6d32019 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:47:45.778160 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-38fce7a6-b2d1-4d4e-946c-ebf1c6d32019 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/b4ed536b-47ac-4405-a11b-e2ed38021db3" status: 200 len: 1679 microversion: 2.1 time: 0.143095 Jun 30 10:47:45.778714 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 398/789] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:47:45 2022] GET /compute/v2.1/servers/b4ed536b-47ac-4405-a11b-e2ed38021db3 => generated 1679 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:47:46.229517 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [req-09ab71f6-2f9f-4cbb-8bde-d4d433ab250e req-0045a40c-08f2-4ddb-a16b-972822c9c889 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a6b5e16-473d-4317-8bf7-ee0df07cb224", "name": "network-vif-plugged", "status": "completed", "tag": "616d9e47-3706-4db1-a51a-9e45603ab16c"}]} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:47:46.233461 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_cell0:SELECT=2 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:47:46.234200 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_cell0:SELECT=10 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:47:46.242023 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-09ab71f6-2f9f-4cbb-8bde-d4d433ab250e req-0045a40c-08f2-4ddb-a16b-972822c9c889 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:46.242473 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-09ab71f6-2f9f-4cbb-8bde-d4d433ab250e req-0045a40c-08f2-4ddb-a16b-972822c9c889 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:46.257021 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.compute.server_external_events [req-09ab71f6-2f9f-4cbb-8bde-d4d433ab250e req-0045a40c-08f2-4ddb-a16b-972822c9c889 service nova] Creating event network-vif-plugged:616d9e47-3706-4db1-a51a-9e45603ab16c for instance 7a6b5e16-473d-4317-8bf7-ee0df07cb224 on hv-cinder-82282 Jun 30 10:47:46.258733 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [req-09ab71f6-2f9f-4cbb-8bde-d4d433ab250e req-0045a40c-08f2-4ddb-a16b-972822c9c889 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032981 Jun 30 10:47:46.259547 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 392/790] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:47:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:47:46.469168 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-8054c4cf-9b4c-47e2-92a7-f5291b1677a8 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:47:46.469762 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-8054c4cf-9b4c-47e2-92a7-f5291b1677a8 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:47:46.471712 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_cell0:SELECT=2 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:47:46.477633 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-8054c4cf-9b4c-47e2-92a7-f5291b1677a8 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:46.478063 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-8054c4cf-9b4c-47e2-92a7-f5291b1677a8 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:46.478831 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-8054c4cf-9b4c-47e2-92a7-f5291b1677a8 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:46.479744 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-8054c4cf-9b4c-47e2-92a7-f5291b1677a8 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:46.611654 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-8054c4cf-9b4c-47e2-92a7-f5291b1677a8 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:47:46.619534 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-8054c4cf-9b4c-47e2-92a7-f5291b1677a8 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:47:46.621043 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-8054c4cf-9b4c-47e2-92a7-f5291b1677a8 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:47:46.622142 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-8054c4cf-9b4c-47e2-92a7-f5291b1677a8 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224" status: 200 len: 1406 microversion: 2.20 time: 0.156889 Jun 30 10:47:46.622700 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 399/791] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:47:46 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:47:46.796859 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-20a429b8-f4d6-4f16-92dc-89bba74f0367 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:47:46.797537 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-20a429b8-f4d6-4f16-92dc-89bba74f0367 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: b4ed536b-47ac-4405-a11b-e2ed38021db3] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:47:46.803541 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-20a429b8-f4d6-4f16-92dc-89bba74f0367 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:46.803984 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-20a429b8-f4d6-4f16-92dc-89bba74f0367 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:46.804769 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-20a429b8-f4d6-4f16-92dc-89bba74f0367 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:46.805203 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-20a429b8-f4d6-4f16-92dc-89bba74f0367 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:46.936027 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-20a429b8-f4d6-4f16-92dc-89bba74f0367 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:47:46.944118 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-20a429b8-f4d6-4f16-92dc-89bba74f0367 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/b4ed536b-47ac-4405-a11b-e2ed38021db3" status: 200 len: 1679 microversion: 2.1 time: 0.152574 Jun 30 10:47:46.944721 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 393/792] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:47:46 2022] GET /compute/v2.1/servers/b4ed536b-47ac-4405-a11b-e2ed38021db3 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:47:47.237303 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [req-6eeadcd9-d91e-4c86-8e97-bbfdc5f9522c req-c714667f-c1fe-4799-8dad-a5623f495167 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4ed536b-47ac-4405-a11b-e2ed38021db3", "name": "network-vif-deleted", "tag": "650e7205-eab8-4f78-9a90-22d014fc7c86"}]} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:47:47.245230 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-6eeadcd9-d91e-4c86-8e97-bbfdc5f9522c req-c714667f-c1fe-4799-8dad-a5623f495167 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:47.245675 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-6eeadcd9-d91e-4c86-8e97-bbfdc5f9522c req-c714667f-c1fe-4799-8dad-a5623f495167 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:47.256284 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.compute.server_external_events [req-6eeadcd9-d91e-4c86-8e97-bbfdc5f9522c req-c714667f-c1fe-4799-8dad-a5623f495167 service nova] Creating event network-vif-deleted:650e7205-eab8-4f78-9a90-22d014fc7c86 for instance b4ed536b-47ac-4405-a11b-e2ed38021db3 on hv-cinder-82282 Jun 30 10:47:47.261555 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [req-6eeadcd9-d91e-4c86-8e97-bbfdc5f9522c req-c714667f-c1fe-4799-8dad-a5623f495167 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028435 Jun 30 10:47:47.262509 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 400/793] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:47:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:47:47.642360 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-46ea307d-18eb-40c9-b103-e099ce7b7720 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:47:47.642964 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-46ea307d-18eb-40c9-b103-e099ce7b7720 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:47:47.650387 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-46ea307d-18eb-40c9-b103-e099ce7b7720 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:47.650956 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-46ea307d-18eb-40c9-b103-e099ce7b7720 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:47.651885 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-46ea307d-18eb-40c9-b103-e099ce7b7720 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:47.652415 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-46ea307d-18eb-40c9-b103-e099ce7b7720 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:47.785886 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-46ea307d-18eb-40c9-b103-e099ce7b7720 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:47:47.794089 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-46ea307d-18eb-40c9-b103-e099ce7b7720 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:47:47.795586 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-46ea307d-18eb-40c9-b103-e099ce7b7720 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:47:47.796895 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-46ea307d-18eb-40c9-b103-e099ce7b7720 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224" status: 200 len: 1406 microversion: 2.20 time: 0.159305 Jun 30 10:47:47.797441 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 394/794] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:47:47 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:47:47.961865 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-52dcc444-55c4-4ca4-8511-bebc8765d2ba tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:47:47.962553 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-52dcc444-55c4-4ca4-8511-bebc8765d2ba tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: b4ed536b-47ac-4405-a11b-e2ed38021db3] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:47:47.968875 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-52dcc444-55c4-4ca4-8511-bebc8765d2ba tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:47.969331 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-52dcc444-55c4-4ca4-8511-bebc8765d2ba tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:47.970101 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-52dcc444-55c4-4ca4-8511-bebc8765d2ba tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:47.970547 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-52dcc444-55c4-4ca4-8511-bebc8765d2ba tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:48.009262 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-52dcc444-55c4-4ca4-8511-bebc8765d2ba tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:48.009736 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-52dcc444-55c4-4ca4-8511-bebc8765d2ba tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:48.010691 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.objects.instance [None req-52dcc444-55c4-4ca4-8511-bebc8765d2ba tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lazy-loading 'fault' on Instance uuid b4ed536b-47ac-4405-a11b-e2ed38021db3 {{(pid=124203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 10:47:48.070067 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-52dcc444-55c4-4ca4-8511-bebc8765d2ba tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:47:48.080646 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-52dcc444-55c4-4ca4-8511-bebc8765d2ba tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/b4ed536b-47ac-4405-a11b-e2ed38021db3" status: 200 len: 1331 microversion: 2.1 time: 0.123286 Jun 30 10:47:48.081771 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 401/795] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:47:47 2022] GET /compute/v2.1/servers/b4ed536b-47ac-4405-a11b-e2ed38021db3 => generated 1331 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:47:48.815087 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-37581f9f-25ec-4ba2-996d-a4a5c24065bd tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:47:48.815659 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-37581f9f-25ec-4ba2-996d-a4a5c24065bd tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:47:48.818073 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:47:48.823655 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-37581f9f-25ec-4ba2-996d-a4a5c24065bd tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:48.824136 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-37581f9f-25ec-4ba2-996d-a4a5c24065bd tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:48.824938 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-37581f9f-25ec-4ba2-996d-a4a5c24065bd tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:48.825403 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-37581f9f-25ec-4ba2-996d-a4a5c24065bd tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:48.953504 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-37581f9f-25ec-4ba2-996d-a4a5c24065bd tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:47:48.961218 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-37581f9f-25ec-4ba2-996d-a4a5c24065bd tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:47:48.962697 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-37581f9f-25ec-4ba2-996d-a4a5c24065bd tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:47:48.963833 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-37581f9f-25ec-4ba2-996d-a4a5c24065bd tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224" status: 200 len: 1597 microversion: 2.20 time: 0.152758 Jun 30 10:47:48.964390 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 395/796] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:47:48 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 => generated 1597 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 10:47:48.981273 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-72738d50-8a47-4b07-8900-5d621a126f0a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:47:48.981760 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-72738d50-8a47-4b07-8900-5d621a126f0a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:47:48.988998 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-72738d50-8a47-4b07-8900-5d621a126f0a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:48.989439 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-72738d50-8a47-4b07-8900-5d621a126f0a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:48.990184 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-72738d50-8a47-4b07-8900-5d621a126f0a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:48.990612 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-72738d50-8a47-4b07-8900-5d621a126f0a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:49.069975 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-72738d50-8a47-4b07-8900-5d621a126f0a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.092500 Jun 30 10:47:49.070564 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 402/797] 10.222.0.59 () {60 vars in 1315 bytes} [Thu Jun 30 10:47:48 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 10:47:49.098455 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-1ab40570-60f7-4939-a062-dbbf71dcddbc tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:47:49.099061 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-1ab40570-60f7-4939-a062-dbbf71dcddbc tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: b4ed536b-47ac-4405-a11b-e2ed38021db3] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:47:49.105014 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1ab40570-60f7-4939-a062-dbbf71dcddbc tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:49.105455 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1ab40570-60f7-4939-a062-dbbf71dcddbc tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:49.106208 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1ab40570-60f7-4939-a062-dbbf71dcddbc tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:49.106634 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1ab40570-60f7-4939-a062-dbbf71dcddbc tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:49.121861 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.wsgi [None req-1ab40570-60f7-4939-a062-dbbf71dcddbc tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] HTTP exception thrown: Instance b4ed536b-47ac-4405-a11b-e2ed38021db3 could not be found. Jun 30 10:47:49.123488 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-1ab40570-60f7-4939-a062-dbbf71dcddbc tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Request method failure captured: Jun 30 10:47:49.123488 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: request: GET /compute/v2.1/servers/b4ed536b-47ac-4405-a11b-e2ed38021db3 HTTP/1.1 Jun 30 10:47:49.123488 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Accept: application/json Jun 30 10:47:49.123488 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Accept-Encoding: identity Jun 30 10:47:49.123488 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Connection: close Jun 30 10:47:49.123488 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Content-Length: 0 Jun 30 10:47:49.123488 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Content-Type: application/json Jun 30 10:47:49.123488 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Host: 10.222.0.59 Jun 30 10:47:49.123488 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Openstack-System-Scope: None Jun 30 10:47:49.123488 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: User-Agent: python-urllib3/1.26.9 Jun 30 10:47:49.123488 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Auth-Token: gAAAAABivX2SDXLzZddWIKNVN1nlKFPwtYJlUUF8PxnvIHmdlvz3CWxsmmlutMh4nwIcp8e29jVTyW0L2PeVImDMIlnOZ-7kokNBpPBYwuv_h-8Q51jKjjG2cB0Se9mEglmc0BxaTnOJa9GnDeBKjS31T1Z6kscoN_FtN_Ly_k2htqmUscjC_wQ Jun 30 10:47:49.123488 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Domain-Id: None Jun 30 10:47:49.123488 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Domain-Name: None Jun 30 10:47:49.123488 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Identity-Status: Confirmed Jun 30 10:47:49.123488 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Is-Admin-Project: True Jun 30 10:47:49.123488 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Domain-Id: default Jun 30 10:47:49.123488 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Domain-Name: Default Jun 30 10:47:49.123488 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Id: 848d69e5041341488aafc3e6d26d491c Jun 30 10:47:49.123488 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Name: tempest-AttachVolumeNegativeTest-1311706498 Jun 30 10:47:49.123488 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Role: member,reader Jun 30 10:47:49.123488 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Roles: member,reader Jun 30 10:47:49.125158 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/848d69e5041341488aafc3e6d26d491c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_848d69e5041341488aafc3e6d26d491c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/848d69e5041341488aafc3e6d26d491c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/848d69e5041341488aafc3e6d26d491c"}]}] Jun 30 10:47:49.125158 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant: tempest-AttachVolumeNegativeTest-1311706498 Jun 30 10:47:49.125158 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant-Id: 848d69e5041341488aafc3e6d26d491c Jun 30 10:47:49.125158 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1311706498 Jun 30 10:47:49.125158 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User: tempest-AttachVolumeNegativeTest-1311706498-project Jun 30 10:47:49.125158 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Domain-Id: default Jun 30 10:47:49.125158 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Domain-Name: Default Jun 30 10:47:49.125158 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Id: d6a194d68415422fbc6ca75a8dbccf22 Jun 30 10:47:49.125158 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Name: tempest-AttachVolumeNegativeTest-1311706498-project Jun 30 10:47:49.125158 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: method: > Jun 30 10:47:49.125158 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: exception: Instance b4ed536b-47ac-4405-a11b-e2ed38021db3 could not be found. Jun 30 10:47:49.125158 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: action_args: {'id': 'b4ed536b-47ac-4405-a11b-e2ed38021db3'} Jun 30 10:47:49.126042 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:47:49.126042 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:47:49.126042 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 10:47:49.126042 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 10:47:49.126042 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 10:47:49.126042 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 10:47:49.126042 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 10:47:49.126042 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 10:47:49.126042 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 10:47:49.126042 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 10:47:49.126042 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4ed536b-47ac-4405-a11b-e2ed38021db3 could not be found. Jun 30 10:47:49.126042 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:47:49.126042 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:47:49.126042 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:47:49.126042 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:47:49.126042 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:47:49.126042 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:47:49.126042 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:47:49.126042 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:47:49.126042 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:47:49.127483 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:47:49.127483 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 10:47:49.127483 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 10:47:49.127483 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 10:47:49.127483 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 10:47:49.127483 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 10:47:49.127483 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:47:49.127483 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4ed536b-47ac-4405-a11b-e2ed38021db3 could not be found. Jun 30 10:47:49.127483 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:47:49.127483 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:47:49.127483 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:47:49.127483 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:47:49.127483 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:47:49.127483 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:47:49.127483 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:47:49.127483 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:47:49.127483 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4ed536b-47ac-4405-a11b-e2ed38021db3 could not be found. Jun 30 10:47:49.127483 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:47:49.128768 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-1ab40570-60f7-4939-a062-dbbf71dcddbc tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Returning 404 to user: Instance b4ed536b-47ac-4405-a11b-e2ed38021db3 could not be found. {{(pid=124204) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:47:49.128768 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-1ab40570-60f7-4939-a062-dbbf71dcddbc tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/b4ed536b-47ac-4405-a11b-e2ed38021db3" status: 404 len: 111 microversion: 2.1 time: 0.030539 Jun 30 10:47:49.128768 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 396/798] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:47:49 2022] GET /compute/v2.1/servers/b4ed536b-47ac-4405-a11b-e2ed38021db3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 30 10:47:49.133768 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-1ee5ef60-3261-4e2d-8a61-57970bac02d4 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '.version_select at 0x7f4db2621dc0>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:47:49.136857 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1ee5ef60-3261-4e2d-8a61-57970bac02d4 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [0c2484db-9864-4376-abcc-61abcd2f5fe5] AMQP server on 10.222.0.59:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 30 10:47:50.148010 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO oslo.messaging._drivers.impl_rabbit [None req-1ee5ef60-3261-4e2d-8a61-57970bac02d4 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [0c2484db-9864-4376-abcc-61abcd2f5fe5] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 52702. Jun 30 10:47:50.150615 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [req-18aaaeb0-95f8-4fea-a072-4447f273524b req-5b819eb5-0323-4531-9fd0-5f81aa1ae7ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a6b5e16-473d-4317-8bf7-ee0df07cb224", "tag": "616d9e47-3706-4db1-a51a-9e45603ab16c"}]} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:47:50.154670 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:47:50.159866 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-18aaaeb0-95f8-4fea-a072-4447f273524b req-5b819eb5-0323-4531-9fd0-5f81aa1ae7ee service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:50.160361 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-18aaaeb0-95f8-4fea-a072-4447f273524b req-5b819eb5-0323-4531-9fd0-5f81aa1ae7ee service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:50.172646 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-1ee5ef60-3261-4e2d-8a61-57970bac02d4 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1025014063" status: 202 len: 0 microversion: 2.1 time: 1.042474 Jun 30 10:47:50.173231 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 403/799] 10.222.0.59 () {58 vars in 1220 bytes} [Thu Jun 30 10:47:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1025014063 => generated 0 bytes in 1044 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 10:47:50.173738 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.compute.server_external_events [req-18aaaeb0-95f8-4fea-a072-4447f273524b req-5b819eb5-0323-4531-9fd0-5f81aa1ae7ee service nova] Creating event network-changed:616d9e47-3706-4db1-a51a-9e45603ab16c for instance 7a6b5e16-473d-4317-8bf7-ee0df07cb224 on hv-cinder-82282 Jun 30 10:47:50.179647 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [req-18aaaeb0-95f8-4fea-a072-4447f273524b req-5b819eb5-0323-4531-9fd0-5f81aa1ae7ee service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032562 Jun 30 10:47:50.180240 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 397/800] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:47:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 10:47:50.434350 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-cb1095f8-e9d2-40a7-922d-7e6ce0f3c216 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:47:50.434988 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-cb1095f8-e9d2-40a7-922d-7e6ce0f3c216 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 3ec80ef6-338b-4924-98e0-295bcb858dd9] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:47:50.442338 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-cb1095f8-e9d2-40a7-922d-7e6ce0f3c216 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:50.442786 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-cb1095f8-e9d2-40a7-922d-7e6ce0f3c216 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:50.443548 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-cb1095f8-e9d2-40a7-922d-7e6ce0f3c216 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:50.443975 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-cb1095f8-e9d2-40a7-922d-7e6ce0f3c216 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:50.592151 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.objects.instance [None req-cb1095f8-e9d2-40a7-922d-7e6ce0f3c216 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lazy-loading 'services' on Instance uuid 3ec80ef6-338b-4924-98e0-295bcb858dd9 {{(pid=124203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 10:47:50.709002 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-cb1095f8-e9d2-40a7-922d-7e6ce0f3c216 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "DELETE /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9/os-volume_attachments/a4b931f6-9989-49b8-8842-9b618fb82025" status: 202 len: 0 microversion: 2.1 time: 0.278612 Jun 30 10:47:50.712895 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 404/801] 10.222.0.59 () {58 vars in 1415 bytes} [Thu Jun 30 10:47:50 2022] DELETE /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9/os-volume_attachments/a4b931f6-9989-49b8-8842-9b618fb82025 => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 10:47:50.719457 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-8cd1f637-bcf0-4187-a0c9-a9110e8c0251 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:47:50.720578 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-8cd1f637-bcf0-4187-a0c9-a9110e8c0251 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 3ec80ef6-338b-4924-98e0-295bcb858dd9] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:47:50.737440 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-8cd1f637-bcf0-4187-a0c9-a9110e8c0251 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:50.738410 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-8cd1f637-bcf0-4187-a0c9-a9110e8c0251 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:50.739474 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-8cd1f637-bcf0-4187-a0c9-a9110e8c0251 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:50.740137 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-8cd1f637-bcf0-4187-a0c9-a9110e8c0251 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:50.780271 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-8cd1f637-bcf0-4187-a0c9-a9110e8c0251 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065022 Jun 30 10:47:50.781810 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 398/802] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 30 10:47:50 2022] GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 10:47:51.571753 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-30589088-f0cc-4e58-825e-56ae391fc119 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:47:51.572332 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-30589088-f0cc-4e58-825e-56ae391fc119 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 6bc2024c-c05e-4409-a142-e8cf3191a203] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:47:51.579354 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-30589088-f0cc-4e58-825e-56ae391fc119 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:51.579805 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-30589088-f0cc-4e58-825e-56ae391fc119 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:51.580603 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-30589088-f0cc-4e58-825e-56ae391fc119 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:51.581039 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-30589088-f0cc-4e58-825e-56ae391fc119 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:51.585519 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:47:51.665772 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.objects.instance [None req-30589088-f0cc-4e58-825e-56ae391fc119 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lazy-loading 'services' on Instance uuid 6bc2024c-c05e-4409-a142-e8cf3191a203 {{(pid=124203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 10:47:51.739030 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-30589088-f0cc-4e58-825e-56ae391fc119 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "DELETE /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203/os-volume_attachments/5895ff83-fbfd-4109-8737-162608139595" status: 202 len: 0 microversion: 2.1 time: 0.172009 Jun 30 10:47:51.739599 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 405/803] 10.222.0.59 () {58 vars in 1415 bytes} [Thu Jun 30 10:47:51 2022] DELETE /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203/os-volume_attachments/5895ff83-fbfd-4109-8737-162608139595 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 30 10:47:51.749545 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-177b374a-27c2-46e3-871d-68abfcdc0085 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:47:51.750485 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-177b374a-27c2-46e3-871d-68abfcdc0085 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 6bc2024c-c05e-4409-a142-e8cf3191a203] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:47:51.757670 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-177b374a-27c2-46e3-871d-68abfcdc0085 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:51.758146 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-177b374a-27c2-46e3-871d-68abfcdc0085 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:51.759079 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-177b374a-27c2-46e3-871d-68abfcdc0085 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:51.760105 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-177b374a-27c2-46e3-871d-68abfcdc0085 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:51.792675 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-177b374a-27c2-46e3-871d-68abfcdc0085 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047887 Jun 30 10:47:51.793470 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 399/804] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 30 10:47:51 2022] GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:47:51.794461 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-613a2e7a-6ab1-4943-878d-741a8d599695 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:47:51.795539 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-613a2e7a-6ab1-4943-878d-741a8d599695 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 3ec80ef6-338b-4924-98e0-295bcb858dd9] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:47:51.802104 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-613a2e7a-6ab1-4943-878d-741a8d599695 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:51.802546 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-613a2e7a-6ab1-4943-878d-741a8d599695 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:51.803300 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-613a2e7a-6ab1-4943-878d-741a8d599695 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:51.803729 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-613a2e7a-6ab1-4943-878d-741a8d599695 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:51.832607 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-613a2e7a-6ab1-4943-878d-741a8d599695 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042325 Jun 30 10:47:51.833172 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 406/805] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 30 10:47:51 2022] GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 30 10:47:51.906426 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-58ba58e5-3a4b-4698-8e77-549001f2ee07 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:47:51.906920 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-58ba58e5-3a4b-4698-8e77-549001f2ee07 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 3ec80ef6-338b-4924-98e0-295bcb858dd9] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:47:51.913072 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-58ba58e5-3a4b-4698-8e77-549001f2ee07 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:51.913519 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-58ba58e5-3a4b-4698-8e77-549001f2ee07 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:51.914281 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-58ba58e5-3a4b-4698-8e77-549001f2ee07 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:51.914724 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-58ba58e5-3a4b-4698-8e77-549001f2ee07 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:51.932906 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_cell1:SELECT=100 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:47:51.941359 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-58ba58e5-3a4b-4698-8e77-549001f2ee07 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 3ec80ef6-338b-4924-98e0-295bcb858dd9] Going to try to terminate instance {{(pid=124204) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 10:47:52.016005 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-58ba58e5-3a4b-4698-8e77-549001f2ee07 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "DELETE /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9" status: 204 len: 0 microversion: 2.1 time: 0.113182 Jun 30 10:47:52.016604 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 400/806] 10.222.0.59 () {58 vars in 1238 bytes} [Thu Jun 30 10:47:51 2022] DELETE /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 10:47:52.024404 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-2f8dd78f-32e1-419d-a850-461b46f86a6e tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:47:52.025076 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-2f8dd78f-32e1-419d-a850-461b46f86a6e tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 3ec80ef6-338b-4924-98e0-295bcb858dd9] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:47:52.031054 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-2f8dd78f-32e1-419d-a850-461b46f86a6e tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:52.031505 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-2f8dd78f-32e1-419d-a850-461b46f86a6e tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:52.032259 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-2f8dd78f-32e1-419d-a850-461b46f86a6e tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:52.032728 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-2f8dd78f-32e1-419d-a850-461b46f86a6e tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:52.165513 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-2f8dd78f-32e1-419d-a850-461b46f86a6e tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:47:52.173607 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-2f8dd78f-32e1-419d-a850-461b46f86a6e tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9" status: 200 len: 1691 microversion: 2.1 time: 0.153001 Jun 30 10:47:52.174341 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 407/807] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:47:52 2022] GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9 => generated 1691 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:47:52.805182 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-7a6c5187-7354-487f-9741-d4f3298f445c tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:47:52.806237 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-7a6c5187-7354-487f-9741-d4f3298f445c tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 6bc2024c-c05e-4409-a142-e8cf3191a203] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:47:52.812966 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-7a6c5187-7354-487f-9741-d4f3298f445c tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:52.813420 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-7a6c5187-7354-487f-9741-d4f3298f445c tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:52.814189 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-7a6c5187-7354-487f-9741-d4f3298f445c tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:52.814629 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-7a6c5187-7354-487f-9741-d4f3298f445c tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:52.844037 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-7a6c5187-7354-487f-9741-d4f3298f445c tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043200 Jun 30 10:47:52.844611 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 401/808] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 30 10:47:52 2022] GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:47:53.191077 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-d969f614-8130-4bab-a9ac-500a11081817 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:47:53.191692 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-d969f614-8130-4bab-a9ac-500a11081817 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 3ec80ef6-338b-4924-98e0-295bcb858dd9] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:47:53.198359 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-d969f614-8130-4bab-a9ac-500a11081817 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:53.198803 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-d969f614-8130-4bab-a9ac-500a11081817 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:53.199566 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-d969f614-8130-4bab-a9ac-500a11081817 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:53.200006 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-d969f614-8130-4bab-a9ac-500a11081817 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:53.326948 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-d969f614-8130-4bab-a9ac-500a11081817 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:47:53.334469 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-d969f614-8130-4bab-a9ac-500a11081817 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9" status: 200 len: 1691 microversion: 2.1 time: 0.147253 Jun 30 10:47:53.335041 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 408/809] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:47:53 2022] GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9 => generated 1691 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:47:53.856211 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-317894bb-96a5-4c30-8ece-b9ae92c02a58 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:47:53.857519 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-317894bb-96a5-4c30-8ece-b9ae92c02a58 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 6bc2024c-c05e-4409-a142-e8cf3191a203] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:47:53.864145 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-317894bb-96a5-4c30-8ece-b9ae92c02a58 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:53.864636 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-317894bb-96a5-4c30-8ece-b9ae92c02a58 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:53.865395 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-317894bb-96a5-4c30-8ece-b9ae92c02a58 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:53.865830 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-317894bb-96a5-4c30-8ece-b9ae92c02a58 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:53.901548 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-317894bb-96a5-4c30-8ece-b9ae92c02a58 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049427 Jun 30 10:47:53.902117 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 402/810] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 30 10:47:53 2022] GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:47:54.351806 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-307b31c3-4764-4381-aa08-e1a21eb3e8df tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:47:54.352416 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-307b31c3-4764-4381-aa08-e1a21eb3e8df tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 3ec80ef6-338b-4924-98e0-295bcb858dd9] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:47:54.359621 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-307b31c3-4764-4381-aa08-e1a21eb3e8df tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:54.360071 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-307b31c3-4764-4381-aa08-e1a21eb3e8df tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:54.360858 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-307b31c3-4764-4381-aa08-e1a21eb3e8df tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:54.361298 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-307b31c3-4764-4381-aa08-e1a21eb3e8df tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:54.490892 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-307b31c3-4764-4381-aa08-e1a21eb3e8df tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:47:54.498269 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-307b31c3-4764-4381-aa08-e1a21eb3e8df tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9" status: 200 len: 1691 microversion: 2.1 time: 0.150293 Jun 30 10:47:54.498913 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 409/811] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:47:54 2022] GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9 => generated 1691 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:47:54.913853 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-a0bf727d-25e8-4079-91a6-f4c9e1245ad5 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:47:54.914778 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-a0bf727d-25e8-4079-91a6-f4c9e1245ad5 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 6bc2024c-c05e-4409-a142-e8cf3191a203] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:47:54.921299 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a0bf727d-25e8-4079-91a6-f4c9e1245ad5 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:54.921743 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a0bf727d-25e8-4079-91a6-f4c9e1245ad5 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:54.922501 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a0bf727d-25e8-4079-91a6-f4c9e1245ad5 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:54.922935 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a0bf727d-25e8-4079-91a6-f4c9e1245ad5 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:54.951958 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-a0bf727d-25e8-4079-91a6-f4c9e1245ad5 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042124 Jun 30 10:47:54.953126 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 403/812] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 30 10:47:54 2022] GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:47:55.515194 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-a5755685-0f89-4c46-895a-2016240c575e tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:47:55.515731 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-a5755685-0f89-4c46-895a-2016240c575e tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 3ec80ef6-338b-4924-98e0-295bcb858dd9] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:47:55.522036 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a5755685-0f89-4c46-895a-2016240c575e tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:55.522473 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a5755685-0f89-4c46-895a-2016240c575e tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:55.523222 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a5755685-0f89-4c46-895a-2016240c575e tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:55.523647 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a5755685-0f89-4c46-895a-2016240c575e tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:55.653122 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-a5755685-0f89-4c46-895a-2016240c575e tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:47:55.661080 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-a5755685-0f89-4c46-895a-2016240c575e tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9" status: 200 len: 1691 microversion: 2.1 time: 0.149888 Jun 30 10:47:55.661644 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 410/813] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:47:55 2022] GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9 => generated 1691 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:47:55.964067 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-e8fcc0f6-53ba-4ed9-b866-134c154b99b3 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:47:55.965014 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-e8fcc0f6-53ba-4ed9-b866-134c154b99b3 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 6bc2024c-c05e-4409-a142-e8cf3191a203] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:47:55.972450 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-e8fcc0f6-53ba-4ed9-b866-134c154b99b3 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:55.972917 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-e8fcc0f6-53ba-4ed9-b866-134c154b99b3 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:55.973675 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-e8fcc0f6-53ba-4ed9-b866-134c154b99b3 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:55.974101 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-e8fcc0f6-53ba-4ed9-b866-134c154b99b3 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:56.002511 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-e8fcc0f6-53ba-4ed9-b866-134c154b99b3 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042264 Jun 30 10:47:56.003234 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 404/814] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 30 10:47:55 2022] GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 30 10:47:56.059208 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-86c9bc67-047a-4f7a-9446-57115f53da31 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:47:56.059698 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-86c9bc67-047a-4f7a-9446-57115f53da31 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 6bc2024c-c05e-4409-a142-e8cf3191a203] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:47:56.065760 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-86c9bc67-047a-4f7a-9446-57115f53da31 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:56.066208 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-86c9bc67-047a-4f7a-9446-57115f53da31 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:56.066956 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-86c9bc67-047a-4f7a-9446-57115f53da31 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:56.067384 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-86c9bc67-047a-4f7a-9446-57115f53da31 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:56.092381 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-86c9bc67-047a-4f7a-9446-57115f53da31 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 6bc2024c-c05e-4409-a142-e8cf3191a203] Going to try to terminate instance {{(pid=124203) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 10:47:56.168346 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-86c9bc67-047a-4f7a-9446-57115f53da31 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "DELETE /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203" status: 204 len: 0 microversion: 2.1 time: 0.112612 Jun 30 10:47:56.169144 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 411/815] 10.222.0.59 () {58 vars in 1238 bytes} [Thu Jun 30 10:47:56 2022] DELETE /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 10:47:56.177341 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-f963803b-7570-4664-af95-d07713bd6b0c tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:47:56.177946 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-f963803b-7570-4664-af95-d07713bd6b0c tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 6bc2024c-c05e-4409-a142-e8cf3191a203] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:47:56.183888 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f963803b-7570-4664-af95-d07713bd6b0c tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:56.184330 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f963803b-7570-4664-af95-d07713bd6b0c tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:56.185105 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f963803b-7570-4664-af95-d07713bd6b0c tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:56.185538 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f963803b-7570-4664-af95-d07713bd6b0c tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:56.320947 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-f963803b-7570-4664-af95-d07713bd6b0c tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:47:56.329166 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-f963803b-7570-4664-af95-d07713bd6b0c tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203" status: 200 len: 1681 microversion: 2.1 time: 0.155585 Jun 30 10:47:56.329870 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 405/816] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:47:56 2022] GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:47:56.636044 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [req-7ea464f4-104a-437b-b02c-c8cf846cdbb5 req-610e6a3f-595b-4d11-97eb-d45a8cbcc7da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ec80ef6-338b-4924-98e0-295bcb858dd9", "name": "network-vif-deleted", "tag": "2f91a1b5-27b0-4bf6-8697-1a3c0ec160b5"}]} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:47:56.644584 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-7ea464f4-104a-437b-b02c-c8cf846cdbb5 req-610e6a3f-595b-4d11-97eb-d45a8cbcc7da service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:56.645105 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-7ea464f4-104a-437b-b02c-c8cf846cdbb5 req-610e6a3f-595b-4d11-97eb-d45a8cbcc7da service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:56.656401 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.compute.server_external_events [req-7ea464f4-104a-437b-b02c-c8cf846cdbb5 req-610e6a3f-595b-4d11-97eb-d45a8cbcc7da service nova] Creating event network-vif-deleted:2f91a1b5-27b0-4bf6-8697-1a3c0ec160b5 for instance 3ec80ef6-338b-4924-98e0-295bcb858dd9 on hv-cinder-82282 Jun 30 10:47:56.661595 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [req-7ea464f4-104a-437b-b02c-c8cf846cdbb5 req-610e6a3f-595b-4d11-97eb-d45a8cbcc7da service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029767 Jun 30 10:47:56.662371 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 412/817] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:47:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:47:56.679911 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-065c0df5-3c9f-4463-b00b-ffddd3273e61 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:47:56.680921 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-065c0df5-3c9f-4463-b00b-ffddd3273e61 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 3ec80ef6-338b-4924-98e0-295bcb858dd9] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:47:56.689049 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-065c0df5-3c9f-4463-b00b-ffddd3273e61 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:56.689734 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-065c0df5-3c9f-4463-b00b-ffddd3273e61 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:56.691170 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-065c0df5-3c9f-4463-b00b-ffddd3273e61 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:56.691862 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-065c0df5-3c9f-4463-b00b-ffddd3273e61 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:56.769337 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-065c0df5-3c9f-4463-b00b-ffddd3273e61 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:47:56.777503 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-065c0df5-3c9f-4463-b00b-ffddd3273e61 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9" status: 200 len: 1331 microversion: 2.1 time: 0.103143 Jun 30 10:47:56.778332 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 406/818] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:47:56 2022] GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9 => generated 1331 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:47:57.348977 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-57128609-1222-4da4-ab5f-cf2254a66766 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:47:57.349762 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-57128609-1222-4da4-ab5f-cf2254a66766 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 6bc2024c-c05e-4409-a142-e8cf3191a203] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:47:57.356321 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-57128609-1222-4da4-ab5f-cf2254a66766 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:57.357007 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-57128609-1222-4da4-ab5f-cf2254a66766 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:57.358296 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-57128609-1222-4da4-ab5f-cf2254a66766 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:57.358833 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-57128609-1222-4da4-ab5f-cf2254a66766 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:57.508633 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-57128609-1222-4da4-ab5f-cf2254a66766 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:47:57.517832 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-57128609-1222-4da4-ab5f-cf2254a66766 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203" status: 200 len: 1681 microversion: 2.1 time: 0.173196 Jun 30 10:47:57.518420 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 413/819] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:47:57 2022] GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203 => generated 1681 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:47:57.803901 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-43e083d9-5b32-4429-937c-5ebb1d7df3e6 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:47:57.807704 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-43e083d9-5b32-4429-937c-5ebb1d7df3e6 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 3ec80ef6-338b-4924-98e0-295bcb858dd9] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:47:57.821597 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-43e083d9-5b32-4429-937c-5ebb1d7df3e6 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:57.822316 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-43e083d9-5b32-4429-937c-5ebb1d7df3e6 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:57.823274 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-43e083d9-5b32-4429-937c-5ebb1d7df3e6 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:57.823966 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-43e083d9-5b32-4429-937c-5ebb1d7df3e6 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:57.841185 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.wsgi [None req-43e083d9-5b32-4429-937c-5ebb1d7df3e6 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] HTTP exception thrown: Instance 3ec80ef6-338b-4924-98e0-295bcb858dd9 could not be found. Jun 30 10:47:57.842833 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-43e083d9-5b32-4429-937c-5ebb1d7df3e6 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Request method failure captured: Jun 30 10:47:57.842833 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: request: GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9 HTTP/1.1 Jun 30 10:47:57.842833 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Accept: application/json Jun 30 10:47:57.842833 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Accept-Encoding: identity Jun 30 10:47:57.842833 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Connection: close Jun 30 10:47:57.842833 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Content-Length: 0 Jun 30 10:47:57.842833 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Content-Type: application/json Jun 30 10:47:57.842833 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Host: 10.222.0.59 Jun 30 10:47:57.842833 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Openstack-System-Scope: None Jun 30 10:47:57.842833 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: User-Agent: python-urllib3/1.26.9 Jun 30 10:47:57.842833 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Auth-Token: gAAAAABivX2IaMKFb8aVjIO9EozePX71KBEfwyqcUMe3SvB2sa7oqzpACr1t048jevq1HnxAZYOcYQ9yz3sn3Mi-zB8W1WY1FWJvqYQmDU-ufetM9QN3XiPs0N0Ey6_49zVeCFmscnoJJ-2J3rZ2Q476IEMQO-fq6f0WYCxQpJ-MOJQFC-ZWmEU Jun 30 10:47:57.842833 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Domain-Id: None Jun 30 10:47:57.842833 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Domain-Name: None Jun 30 10:47:57.842833 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Identity-Status: Confirmed Jun 30 10:47:57.842833 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Is-Admin-Project: True Jun 30 10:47:57.842833 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Domain-Id: default Jun 30 10:47:57.842833 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Domain-Name: Default Jun 30 10:47:57.842833 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Id: 0e38b1cc4c0d45a8b38ba7b670f83c79 Jun 30 10:47:57.842833 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1656404926 Jun 30 10:47:57.842833 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Role: member,reader Jun 30 10:47:57.842833 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Roles: member,reader Jun 30 10:47:57.844487 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0e38b1cc4c0d45a8b38ba7b670f83c79"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0e38b1cc4c0d45a8b38ba7b670f83c79"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0e38b1cc4c0d45a8b38ba7b670f83c79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0e38b1cc4c0d45a8b38ba7b670f83c79"}]}] Jun 30 10:47:57.844487 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1656404926 Jun 30 10:47:57.844487 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant-Id: 0e38b1cc4c0d45a8b38ba7b670f83c79 Jun 30 10:47:57.844487 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1656404926 Jun 30 10:47:57.844487 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User: tempest-ServerRescueNegativeTestJSON-1656404926-project Jun 30 10:47:57.844487 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Domain-Id: default Jun 30 10:47:57.844487 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Domain-Name: Default Jun 30 10:47:57.844487 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Id: 6c963986b46d4d148fc843b0a1183d69 Jun 30 10:47:57.844487 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1656404926-project Jun 30 10:47:57.844487 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: method: > Jun 30 10:47:57.844487 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: exception: Instance 3ec80ef6-338b-4924-98e0-295bcb858dd9 could not be found. Jun 30 10:47:57.844487 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: action_args: {'id': '3ec80ef6-338b-4924-98e0-295bcb858dd9'} Jun 30 10:47:57.845765 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:47:57.845765 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:47:57.845765 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 10:47:57.845765 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 10:47:57.845765 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 10:47:57.845765 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 10:47:57.845765 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 10:47:57.845765 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 10:47:57.845765 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 10:47:57.845765 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 10:47:57.845765 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ec80ef6-338b-4924-98e0-295bcb858dd9 could not be found. Jun 30 10:47:57.845765 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:47:57.845765 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:47:57.845765 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:47:57.845765 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:47:57.845765 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:47:57.845765 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:47:57.845765 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:47:57.845765 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:47:57.845765 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:47:57.847292 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:47:57.847292 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 10:47:57.847292 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 10:47:57.847292 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 10:47:57.847292 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 10:47:57.847292 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 10:47:57.847292 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:47:57.847292 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ec80ef6-338b-4924-98e0-295bcb858dd9 could not be found. Jun 30 10:47:57.847292 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:47:57.847292 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:47:57.847292 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:47:57.847292 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:47:57.847292 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:47:57.847292 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:47:57.847292 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:47:57.847292 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:47:57.847292 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ec80ef6-338b-4924-98e0-295bcb858dd9 could not be found. Jun 30 10:47:57.847292 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:47:57.849392 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-43e083d9-5b32-4429-937c-5ebb1d7df3e6 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Returning 404 to user: Instance 3ec80ef6-338b-4924-98e0-295bcb858dd9 could not be found. {{(pid=124204) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:47:57.849392 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-43e083d9-5b32-4429-937c-5ebb1d7df3e6 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9" status: 404 len: 111 microversion: 2.1 time: 0.051941 Jun 30 10:47:57.849392 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 407/820] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:47:57 2022] GET /compute/v2.1/servers/3ec80ef6-338b-4924-98e0-295bcb858dd9 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 10:47:57.854540 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-403ce187-9380-4dbf-87bc-6d6c74eb096a tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '.version_select at 0x7f4db2648940>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:47:57.875095 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-403ce187-9380-4dbf-87bc-6d6c74eb096a tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1899886986" status: 202 len: 0 microversion: 2.1 time: 0.024224 Jun 30 10:47:57.875919 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 414/821] 10.222.0.59 () {58 vars in 1220 bytes} [Thu Jun 30 10:47:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1899886986 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 10:47:58.535765 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-c0769881-05b8-470a-98eb-e39b8122a030 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:47:58.536325 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-c0769881-05b8-470a-98eb-e39b8122a030 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 6bc2024c-c05e-4409-a142-e8cf3191a203] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:47:58.542552 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c0769881-05b8-470a-98eb-e39b8122a030 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:58.543002 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c0769881-05b8-470a-98eb-e39b8122a030 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:58.543852 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c0769881-05b8-470a-98eb-e39b8122a030 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:58.544289 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c0769881-05b8-470a-98eb-e39b8122a030 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:58.583061 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c0769881-05b8-470a-98eb-e39b8122a030 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:58.583751 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c0769881-05b8-470a-98eb-e39b8122a030 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:58.584528 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.objects.instance [None req-c0769881-05b8-470a-98eb-e39b8122a030 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lazy-loading 'fault' on Instance uuid 6bc2024c-c05e-4409-a142-e8cf3191a203 {{(pid=124204) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 10:47:58.673159 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-c0769881-05b8-470a-98eb-e39b8122a030 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:47:58.687396 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-c0769881-05b8-470a-98eb-e39b8122a030 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203" status: 200 len: 1330 microversion: 2.1 time: 0.153759 Jun 30 10:47:58.688266 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 408/822] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:47:58 2022] GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203 => generated 1330 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:47:58.701162 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [req-9a70658f-fd2d-4c3d-94de-e833f740aa89 req-adbe125e-0b25-44cc-ad49-9f159ab0a88c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bc2024c-c05e-4409-a142-e8cf3191a203", "name": "network-vif-deleted", "tag": "90e52b50-5114-40c4-a042-20650fd1b094"}]} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:47:58.712826 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-9a70658f-fd2d-4c3d-94de-e833f740aa89 req-adbe125e-0b25-44cc-ad49-9f159ab0a88c service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:58.718361 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-9a70658f-fd2d-4c3d-94de-e833f740aa89 req-adbe125e-0b25-44cc-ad49-9f159ab0a88c service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:58.742725 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.compute.server_external_events [req-9a70658f-fd2d-4c3d-94de-e833f740aa89 req-adbe125e-0b25-44cc-ad49-9f159ab0a88c service nova] Creating event network-vif-deleted:90e52b50-5114-40c4-a042-20650fd1b094 for instance 6bc2024c-c05e-4409-a142-e8cf3191a203 on hv-cinder-82282 Jun 30 10:47:58.758514 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [req-9a70658f-fd2d-4c3d-94de-e833f740aa89 req-adbe125e-0b25-44cc-ad49-9f159ab0a88c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060625 Jun 30 10:47:58.759262 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 415/823] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:47:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:47:59.704907 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-83f0bc4e-995f-4535-ba01-dc95ba8ace99 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:47:59.705443 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-83f0bc4e-995f-4535-ba01-dc95ba8ace99 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 6bc2024c-c05e-4409-a142-e8cf3191a203] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:47:59.711884 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-83f0bc4e-995f-4535-ba01-dc95ba8ace99 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:59.712328 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-83f0bc4e-995f-4535-ba01-dc95ba8ace99 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:59.713120 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-83f0bc4e-995f-4535-ba01-dc95ba8ace99 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:47:59.713553 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-83f0bc4e-995f-4535-ba01-dc95ba8ace99 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:47:59.726671 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.wsgi [None req-83f0bc4e-995f-4535-ba01-dc95ba8ace99 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] HTTP exception thrown: Instance 6bc2024c-c05e-4409-a142-e8cf3191a203 could not be found. Jun 30 10:47:59.728156 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-83f0bc4e-995f-4535-ba01-dc95ba8ace99 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Request method failure captured: Jun 30 10:47:59.728156 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: request: GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203 HTTP/1.1 Jun 30 10:47:59.728156 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Accept: application/json Jun 30 10:47:59.728156 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Accept-Encoding: identity Jun 30 10:47:59.728156 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Connection: close Jun 30 10:47:59.728156 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Content-Length: 0 Jun 30 10:47:59.728156 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Content-Type: application/json Jun 30 10:47:59.728156 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Host: 10.222.0.59 Jun 30 10:47:59.728156 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Openstack-System-Scope: None Jun 30 10:47:59.728156 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: User-Agent: python-urllib3/1.26.9 Jun 30 10:47:59.728156 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Auth-Token: gAAAAABivX2SDXLzZddWIKNVN1nlKFPwtYJlUUF8PxnvIHmdlvz3CWxsmmlutMh4nwIcp8e29jVTyW0L2PeVImDMIlnOZ-7kokNBpPBYwuv_h-8Q51jKjjG2cB0Se9mEglmc0BxaTnOJa9GnDeBKjS31T1Z6kscoN_FtN_Ly_k2htqmUscjC_wQ Jun 30 10:47:59.728156 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Domain-Id: None Jun 30 10:47:59.728156 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Domain-Name: None Jun 30 10:47:59.728156 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Identity-Status: Confirmed Jun 30 10:47:59.728156 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Is-Admin-Project: True Jun 30 10:47:59.728156 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Domain-Id: default Jun 30 10:47:59.728156 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Domain-Name: Default Jun 30 10:47:59.728156 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Id: 848d69e5041341488aafc3e6d26d491c Jun 30 10:47:59.728156 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Name: tempest-AttachVolumeNegativeTest-1311706498 Jun 30 10:47:59.728156 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Role: member,reader Jun 30 10:47:59.728156 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Roles: member,reader Jun 30 10:47:59.729699 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/848d69e5041341488aafc3e6d26d491c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_848d69e5041341488aafc3e6d26d491c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/848d69e5041341488aafc3e6d26d491c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/848d69e5041341488aafc3e6d26d491c"}]}] Jun 30 10:47:59.729699 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant: tempest-AttachVolumeNegativeTest-1311706498 Jun 30 10:47:59.729699 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant-Id: 848d69e5041341488aafc3e6d26d491c Jun 30 10:47:59.729699 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1311706498 Jun 30 10:47:59.729699 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User: tempest-AttachVolumeNegativeTest-1311706498-project Jun 30 10:47:59.729699 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Domain-Id: default Jun 30 10:47:59.729699 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Domain-Name: Default Jun 30 10:47:59.729699 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Id: d6a194d68415422fbc6ca75a8dbccf22 Jun 30 10:47:59.729699 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Name: tempest-AttachVolumeNegativeTest-1311706498-project Jun 30 10:47:59.729699 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: method: > Jun 30 10:47:59.729699 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: exception: Instance 6bc2024c-c05e-4409-a142-e8cf3191a203 could not be found. Jun 30 10:47:59.729699 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: action_args: {'id': '6bc2024c-c05e-4409-a142-e8cf3191a203'} Jun 30 10:47:59.730636 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:47:59.730636 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:47:59.730636 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 10:47:59.730636 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 10:47:59.730636 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 10:47:59.730636 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 10:47:59.730636 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 10:47:59.730636 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 10:47:59.730636 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 10:47:59.730636 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 10:47:59.730636 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bc2024c-c05e-4409-a142-e8cf3191a203 could not be found. Jun 30 10:47:59.730636 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:47:59.730636 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:47:59.730636 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:47:59.730636 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:47:59.730636 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:47:59.730636 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:47:59.730636 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:47:59.730636 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:47:59.730636 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:47:59.732008 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:47:59.732008 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 10:47:59.732008 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 10:47:59.732008 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 10:47:59.732008 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 10:47:59.732008 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 10:47:59.732008 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:47:59.732008 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bc2024c-c05e-4409-a142-e8cf3191a203 could not be found. Jun 30 10:47:59.732008 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:47:59.732008 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:47:59.732008 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:47:59.732008 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:47:59.732008 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:47:59.732008 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:47:59.732008 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:47:59.732008 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:47:59.732008 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bc2024c-c05e-4409-a142-e8cf3191a203 could not be found. Jun 30 10:47:59.732008 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:47:59.734085 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-83f0bc4e-995f-4535-ba01-dc95ba8ace99 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Returning 404 to user: Instance 6bc2024c-c05e-4409-a142-e8cf3191a203 could not be found. {{(pid=124204) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:47:59.734085 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-83f0bc4e-995f-4535-ba01-dc95ba8ace99 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203" status: 404 len: 111 microversion: 2.1 time: 0.028715 Jun 30 10:47:59.734085 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 409/824] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:47:59 2022] GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 10:47:59.740070 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-d4347f52-2c70-412b-b5af-88fea69102f4 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '.version_select at 0x7f4db2648940>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:47:59.757210 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-d4347f52-2c70-412b-b5af-88fea69102f4 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-379202773" status: 202 len: 0 microversion: 2.1 time: 0.021693 Jun 30 10:47:59.757752 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 416/825] 10.222.0.59 () {58 vars in 1217 bytes} [Thu Jun 30 10:47:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-379202773 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 10:48:00.392199 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-d1f53201-42a2-4d8e-b05c-86222b444269 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Action: 'create', calling method: .version_select at 0x7f4dadd7d820>, body: {"keypair": {"name": "tempest-keypair-1657334136", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCifoEvP1LTEcxN/9NZx7yWpkNHzR1vxDlY/mAQCrbdwq47Q20y/5BiwszZR8etfwyqByAATfdYfIi85xyc5jFKtkAhMIsxhtCoVzhvcviW9kfG67XoCE8i3M+LM7GPwcA=="}} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:48:00.406122 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.quota [None req-d1f53201-42a2-4d8e-b05c-86222b444269 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Getting quotas for project 848d69e5041341488aafc3e6d26d491c. Resources: {'key_pairs'} {{(pid=124204) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 10:48:00.409911 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.quota [None req-d1f53201-42a2-4d8e-b05c-86222b444269 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Getting quotas for user d6a194d68415422fbc6ca75a8dbccf22 and project 848d69e5041341488aafc3e6d26d491c. Resources: {'key_pairs'} {{(pid=124204) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 10:48:00.431209 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-d1f53201-42a2-4d8e-b05c-86222b444269 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.043120 Jun 30 10:48:00.431794 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 410/826] 10.222.0.59 () {60 vars in 1158 bytes} [Thu Jun 30 10:48:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:48:01.029190 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-6067fc68-e739-42af-a29a-5298e527f07b tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:48:01.029935 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-6067fc68-e739-42af-a29a-5298e527f07b tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:48:01.038469 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-6067fc68-e739-42af-a29a-5298e527f07b tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:48:01.038923 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-6067fc68-e739-42af-a29a-5298e527f07b tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:48:01.039694 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-6067fc68-e739-42af-a29a-5298e527f07b tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:48:01.040257 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-6067fc68-e739-42af-a29a-5298e527f07b tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:48:01.064608 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-6067fc68-e739-42af-a29a-5298e527f07b tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Going to try to terminate instance {{(pid=124203) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 10:48:01.145205 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-6067fc68-e739-42af-a29a-5298e527f07b tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "DELETE /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 204 len: 0 microversion: 2.1 time: 0.120049 Jun 30 10:48:01.146838 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 417/827] 10.222.0.59 () {58 vars in 1238 bytes} [Thu Jun 30 10:48:01 2022] DELETE /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 30 10:48:01.156613 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-ae5ca811-64ca-4065-adf4-e411cddcf86a tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:48:01.157862 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-ae5ca811-64ca-4065-adf4-e411cddcf86a tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:48:01.165308 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ae5ca811-64ca-4065-adf4-e411cddcf86a tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:48:01.165759 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ae5ca811-64ca-4065-adf4-e411cddcf86a tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:48:01.166538 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ae5ca811-64ca-4065-adf4-e411cddcf86a tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:48:01.166974 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ae5ca811-64ca-4065-adf4-e411cddcf86a tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:48:01.299857 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-ae5ca811-64ca-4065-adf4-e411cddcf86a tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:48:01.307786 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-ae5ca811-64ca-4065-adf4-e411cddcf86a tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1506 microversion: 2.1 time: 0.156937 Jun 30 10:48:01.308353 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 411/828] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:48:01 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:48:01.653373 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-30395546-960f-4766-a80f-ed69b6749659 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1833851510", "imageRef": "c473bd04-5a45-4eb7-b6f4-2b5033d4fc1d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e1b0416a-2d8f-4305-a932-70d38f831d37"}], "security_groups": [{"name": "tempest-securitygroup--346063857"}], "key_name": "tempest-keypair-1657334136", "user_data": "}} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:48:01.758782 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.network.neutron [None req-30395546-960f-4766-a80f-ed69b6749659 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] validate_networks() for [('e1b0416a-2d8f-4305-a932-70d38f831d37', None, None, None, None, None)] {{(pid=124203) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 10:48:02.136740 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.virt.hardware [None req-30395546-960f-4766-a80f-ed69b6749659 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Flavor limits 0:0:0 {{(pid=124203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 10:48:02.137355 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.virt.hardware [None req-30395546-960f-4766-a80f-ed69b6749659 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Image limits 0:0:0 {{(pid=124203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 10:48:02.137765 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.virt.hardware [None req-30395546-960f-4766-a80f-ed69b6749659 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Flavor pref 0:0:0 {{(pid=124203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 10:48:02.138291 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.virt.hardware [None req-30395546-960f-4766-a80f-ed69b6749659 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Image pref 0:0:0 {{(pid=124203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 10:48:02.138799 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.virt.hardware [None req-30395546-960f-4766-a80f-ed69b6749659 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 10:48:02.147843 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-30395546-960f-4766-a80f-ed69b6749659 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:48:02.148285 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-30395546-960f-4766-a80f-ed69b6749659 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:48:02.149125 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-30395546-960f-4766-a80f-ed69b6749659 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:48:02.149531 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-30395546-960f-4766-a80f-ed69b6749659 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:48:02.166380 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.quota [None req-30395546-960f-4766-a80f-ed69b6749659 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Getting quotas for project 848d69e5041341488aafc3e6d26d491c. Resources: {'instances', 'cores', 'ram'} {{(pid=124203) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 10:48:02.170392 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.quota [None req-30395546-960f-4766-a80f-ed69b6749659 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Getting quotas for user d6a194d68415422fbc6ca75a8dbccf22 and project 848d69e5041341488aafc3e6d26d491c. Resources: {'instances', 'cores', 'ram'} {{(pid=124203) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 10:48:02.182492 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-30395546-960f-4766-a80f-ed69b6749659 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Going to run 1 instances... {{(pid=124203) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 10:48:02.184879 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-30395546-960f-4766-a80f-ed69b6749659 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 5729f9ae-3c4d-490a-9501-b4806724de9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c473bd04-5a45-4eb7-b6f4-2b5033d4fc1d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124203) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 10:48:02.230895 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR oslo.messaging._drivers.impl_rabbit [None req-30395546-960f-4766-a80f-ed69b6749659 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [868465c7-c1c5-48d6-a675-60fa138bb34c] AMQP server on 10.222.0.59:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 30 10:48:02.324862 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-223b66f8-c5da-4b55-8819-8f7b5ef46496 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:48:02.325613 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-223b66f8-c5da-4b55-8819-8f7b5ef46496 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:48:02.332425 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-223b66f8-c5da-4b55-8819-8f7b5ef46496 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:48:02.333013 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-223b66f8-c5da-4b55-8819-8f7b5ef46496 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:48:02.333788 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-223b66f8-c5da-4b55-8819-8f7b5ef46496 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:48:02.334219 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-223b66f8-c5da-4b55-8819-8f7b5ef46496 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:48:02.469648 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-223b66f8-c5da-4b55-8819-8f7b5ef46496 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:48:02.477074 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-223b66f8-c5da-4b55-8819-8f7b5ef46496 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 200 len: 1506 microversion: 2.1 time: 0.156184 Jun 30 10:48:02.477647 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 412/829] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:48:02 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:48:02.570423 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [req-f8bc54cd-8267-4697-b1dc-db6f4578320e req-fd132671-b66a-4c0f-b425-9a5f8b2200f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecd0d1a0-003c-4199-984a-80b41602909f", "name": "network-vif-deleted", "tag": "8f7bc5c0-f904-466a-8e66-4bf59256553e"}]} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:48:02.581305 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-f8bc54cd-8267-4697-b1dc-db6f4578320e req-fd132671-b66a-4c0f-b425-9a5f8b2200f8 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:48:02.582003 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-f8bc54cd-8267-4697-b1dc-db6f4578320e req-fd132671-b66a-4c0f-b425-9a5f8b2200f8 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:48:02.595081 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.compute.server_external_events [req-f8bc54cd-8267-4697-b1dc-db6f4578320e req-fd132671-b66a-4c0f-b425-9a5f8b2200f8 service nova] Creating event network-vif-deleted:8f7bc5c0-f904-466a-8e66-4bf59256553e for instance ecd0d1a0-003c-4199-984a-80b41602909f on hv-cinder-82282 Jun 30 10:48:02.601202 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [req-f8bc54cd-8267-4697-b1dc-db6f4578320e req-fd132671-b66a-4c0f-b425-9a5f8b2200f8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034654 Jun 30 10:48:02.601804 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 413/830] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:48:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 10:48:03.238919 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO oslo.messaging._drivers.impl_rabbit [None req-30395546-960f-4766-a80f-ed69b6749659 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [868465c7-c1c5-48d6-a675-60fa138bb34c] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 52836. Jun 30 10:48:03.243050 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-30395546-960f-4766-a80f-ed69b6749659 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.600767 Jun 30 10:48:03.243693 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 418/831] 10.222.0.59 () {60 vars in 1146 bytes} [Thu Jun 30 10:48:01 2022] POST /compute/v2.1/servers => generated 401 bytes in 1602 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 10:48:03.254147 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-342f323c-36d5-4cb5-89cb-a15cc1be43ee tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:48:03.255080 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-342f323c-36d5-4cb5-89cb-a15cc1be43ee tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 5729f9ae-3c4d-490a-9501-b4806724de9d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:48:03.311169 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-342f323c-36d5-4cb5-89cb-a15cc1be43ee tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:48:03.318618 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-342f323c-36d5-4cb5-89cb-a15cc1be43ee tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/5729f9ae-3c4d-490a-9501-b4806724de9d" status: 200 len: 1242 microversion: 2.1 time: 0.068671 Jun 30 10:48:03.319536 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 414/832] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:48:03 2022] GET /compute/v2.1/servers/5729f9ae-3c4d-490a-9501-b4806724de9d => generated 1242 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:48:03.495252 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-99edc70b-c6dc-41a9-a0d4-fe6c42372124 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:48:03.495782 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-99edc70b-c6dc-41a9-a0d4-fe6c42372124 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: ecd0d1a0-003c-4199-984a-80b41602909f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:48:03.503405 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-99edc70b-c6dc-41a9-a0d4-fe6c42372124 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:48:03.504337 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-99edc70b-c6dc-41a9-a0d4-fe6c42372124 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:48:03.505286 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-99edc70b-c6dc-41a9-a0d4-fe6c42372124 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:48:03.505729 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-99edc70b-c6dc-41a9-a0d4-fe6c42372124 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:48:03.519789 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.wsgi [None req-99edc70b-c6dc-41a9-a0d4-fe6c42372124 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] HTTP exception thrown: Instance ecd0d1a0-003c-4199-984a-80b41602909f could not be found. Jun 30 10:48:03.521558 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-99edc70b-c6dc-41a9-a0d4-fe6c42372124 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Request method failure captured: Jun 30 10:48:03.521558 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: request: GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f HTTP/1.1 Jun 30 10:48:03.521558 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Accept: application/json Jun 30 10:48:03.521558 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Accept-Encoding: identity Jun 30 10:48:03.521558 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Connection: close Jun 30 10:48:03.521558 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Content-Length: 0 Jun 30 10:48:03.521558 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Content-Type: application/json Jun 30 10:48:03.521558 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Host: 10.222.0.59 Jun 30 10:48:03.521558 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Openstack-System-Scope: None Jun 30 10:48:03.521558 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: User-Agent: python-urllib3/1.26.9 Jun 30 10:48:03.521558 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Auth-Token: gAAAAABivX2IaMKFb8aVjIO9EozePX71KBEfwyqcUMe3SvB2sa7oqzpACr1t048jevq1HnxAZYOcYQ9yz3sn3Mi-zB8W1WY1FWJvqYQmDU-ufetM9QN3XiPs0N0Ey6_49zVeCFmscnoJJ-2J3rZ2Q476IEMQO-fq6f0WYCxQpJ-MOJQFC-ZWmEU Jun 30 10:48:03.521558 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Domain-Id: None Jun 30 10:48:03.521558 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Domain-Name: None Jun 30 10:48:03.521558 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Identity-Status: Confirmed Jun 30 10:48:03.521558 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Is-Admin-Project: True Jun 30 10:48:03.521558 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Domain-Id: default Jun 30 10:48:03.521558 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Domain-Name: Default Jun 30 10:48:03.521558 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Id: 0e38b1cc4c0d45a8b38ba7b670f83c79 Jun 30 10:48:03.521558 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1656404926 Jun 30 10:48:03.521558 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Role: member,reader Jun 30 10:48:03.521558 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Roles: member,reader Jun 30 10:48:03.523159 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0e38b1cc4c0d45a8b38ba7b670f83c79"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0e38b1cc4c0d45a8b38ba7b670f83c79"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0e38b1cc4c0d45a8b38ba7b670f83c79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0e38b1cc4c0d45a8b38ba7b670f83c79"}]}] Jun 30 10:48:03.523159 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1656404926 Jun 30 10:48:03.523159 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant-Id: 0e38b1cc4c0d45a8b38ba7b670f83c79 Jun 30 10:48:03.523159 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1656404926 Jun 30 10:48:03.523159 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User: tempest-ServerRescueNegativeTestJSON-1656404926-project Jun 30 10:48:03.523159 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Domain-Id: default Jun 30 10:48:03.523159 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Domain-Name: Default Jun 30 10:48:03.523159 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Id: 6c963986b46d4d148fc843b0a1183d69 Jun 30 10:48:03.523159 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1656404926-project Jun 30 10:48:03.523159 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: method: > Jun 30 10:48:03.523159 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: exception: Instance ecd0d1a0-003c-4199-984a-80b41602909f could not be found. Jun 30 10:48:03.523159 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: action_args: {'id': 'ecd0d1a0-003c-4199-984a-80b41602909f'} Jun 30 10:48:03.527716 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:48:03.527716 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:48:03.527716 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 10:48:03.527716 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 10:48:03.527716 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 10:48:03.527716 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 10:48:03.527716 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 10:48:03.527716 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 10:48:03.527716 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 10:48:03.527716 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 10:48:03.527716 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecd0d1a0-003c-4199-984a-80b41602909f could not be found. Jun 30 10:48:03.527716 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:48:03.527716 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:48:03.527716 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:48:03.527716 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:48:03.527716 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:48:03.527716 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:48:03.527716 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:48:03.527716 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:48:03.527716 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:48:03.529171 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:48:03.529171 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 10:48:03.529171 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 10:48:03.529171 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 10:48:03.529171 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 10:48:03.529171 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 10:48:03.529171 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:48:03.529171 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecd0d1a0-003c-4199-984a-80b41602909f could not be found. Jun 30 10:48:03.529171 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:48:03.529171 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:48:03.529171 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:48:03.529171 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:48:03.529171 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:48:03.529171 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:48:03.529171 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:48:03.529171 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:48:03.529171 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecd0d1a0-003c-4199-984a-80b41602909f could not be found. Jun 30 10:48:03.529171 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:48:03.531136 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-99edc70b-c6dc-41a9-a0d4-fe6c42372124 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Returning 404 to user: Instance ecd0d1a0-003c-4199-984a-80b41602909f could not be found. {{(pid=124203) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:48:03.531136 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-99edc70b-c6dc-41a9-a0d4-fe6c42372124 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f" status: 404 len: 111 microversion: 2.1 time: 0.031706 Jun 30 10:48:03.531136 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 419/833] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:48:03 2022] GET /compute/v2.1/servers/ecd0d1a0-003c-4199-984a-80b41602909f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 10:48:03.536982 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-a615d100-3ec5-4d6b-917c-bccdc1735f38 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:48:03.537472 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-a615d100-3ec5-4d6b-917c-bccdc1735f38 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 109c8a70-7b89-45b4-8876-a3286375b27d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:48:03.544195 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a615d100-3ec5-4d6b-917c-bccdc1735f38 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:48:03.544678 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a615d100-3ec5-4d6b-917c-bccdc1735f38 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:48:03.545448 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a615d100-3ec5-4d6b-917c-bccdc1735f38 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:48:03.545883 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a615d100-3ec5-4d6b-917c-bccdc1735f38 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:48:03.573326 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-a615d100-3ec5-4d6b-917c-bccdc1735f38 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 109c8a70-7b89-45b4-8876-a3286375b27d] Going to try to terminate instance {{(pid=124204) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 10:48:03.653638 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-a615d100-3ec5-4d6b-917c-bccdc1735f38 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "DELETE /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d" status: 204 len: 0 microversion: 2.1 time: 0.125184 Jun 30 10:48:03.654592 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 415/834] 10.222.0.59 () {58 vars in 1238 bytes} [Thu Jun 30 10:48:03 2022] DELETE /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 10:48:03.663508 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-2d6c7722-aa68-474e-bab7-05918a821da8 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:48:03.664246 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-2d6c7722-aa68-474e-bab7-05918a821da8 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 109c8a70-7b89-45b4-8876-a3286375b27d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:48:03.670807 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-2d6c7722-aa68-474e-bab7-05918a821da8 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:48:03.671472 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-2d6c7722-aa68-474e-bab7-05918a821da8 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:48:03.672429 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-2d6c7722-aa68-474e-bab7-05918a821da8 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:48:03.673074 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-2d6c7722-aa68-474e-bab7-05918a821da8 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:48:03.799531 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-2d6c7722-aa68-474e-bab7-05918a821da8 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:48:03.806905 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-2d6c7722-aa68-474e-bab7-05918a821da8 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d" status: 200 len: 1519 microversion: 2.1 time: 0.147800 Jun 30 10:48:03.807458 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 420/835] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:48:03 2022] GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d => generated 1519 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:48:04.336661 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-38c8c6c3-8f30-4145-bb13-288b83d99039 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:48:04.337368 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-38c8c6c3-8f30-4145-bb13-288b83d99039 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 5729f9ae-3c4d-490a-9501-b4806724de9d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:48:04.343562 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-38c8c6c3-8f30-4145-bb13-288b83d99039 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:48:04.344011 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-38c8c6c3-8f30-4145-bb13-288b83d99039 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:48:04.344798 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-38c8c6c3-8f30-4145-bb13-288b83d99039 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:48:04.345240 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-38c8c6c3-8f30-4145-bb13-288b83d99039 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:48:04.410446 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-38c8c6c3-8f30-4145-bb13-288b83d99039 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:48:04.417764 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-38c8c6c3-8f30-4145-bb13-288b83d99039 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/5729f9ae-3c4d-490a-9501-b4806724de9d" status: 200 len: 1238 microversion: 2.1 time: 0.085372 Jun 30 10:48:04.418336 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 416/836] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:48:04 2022] GET /compute/v2.1/servers/5729f9ae-3c4d-490a-9501-b4806724de9d => generated 1238 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:48:04.824492 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-778c74cf-2ddc-40ee-8f0c-70d832587bed tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:48:04.825074 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-778c74cf-2ddc-40ee-8f0c-70d832587bed tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 109c8a70-7b89-45b4-8876-a3286375b27d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:48:04.831953 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-778c74cf-2ddc-40ee-8f0c-70d832587bed tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:48:04.832401 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-778c74cf-2ddc-40ee-8f0c-70d832587bed tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:48:04.833194 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-778c74cf-2ddc-40ee-8f0c-70d832587bed tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:48:04.833632 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-778c74cf-2ddc-40ee-8f0c-70d832587bed tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:48:04.960895 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-778c74cf-2ddc-40ee-8f0c-70d832587bed tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:48:04.968814 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-778c74cf-2ddc-40ee-8f0c-70d832587bed tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d" status: 200 len: 1519 microversion: 2.1 time: 0.148416 Jun 30 10:48:04.969370 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 421/837] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:48:04 2022] GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d => generated 1519 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:48:05.435236 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-ec2c276d-34c0-4a57-b9fa-1d360052896e tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:48:05.435886 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-ec2c276d-34c0-4a57-b9fa-1d360052896e tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 5729f9ae-3c4d-490a-9501-b4806724de9d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:48:05.443088 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ec2c276d-34c0-4a57-b9fa-1d360052896e tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:48:05.443543 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ec2c276d-34c0-4a57-b9fa-1d360052896e tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:48:05.444304 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ec2c276d-34c0-4a57-b9fa-1d360052896e tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:48:05.444784 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ec2c276d-34c0-4a57-b9fa-1d360052896e tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:48:05.464800 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:48:05.509751 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-ec2c276d-34c0-4a57-b9fa-1d360052896e tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:48:05.517824 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-ec2c276d-34c0-4a57-b9fa-1d360052896e tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/5729f9ae-3c4d-490a-9501-b4806724de9d" status: 200 len: 1294 microversion: 2.1 time: 0.086615 Jun 30 10:48:05.518389 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 417/838] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:48:05 2022] GET /compute/v2.1/servers/5729f9ae-3c4d-490a-9501-b4806724de9d => generated 1294 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:48:05.986237 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-1ab85443-bf96-49b0-91d5-ef5fbf3855d1 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:48:05.986840 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-1ab85443-bf96-49b0-91d5-ef5fbf3855d1 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 109c8a70-7b89-45b4-8876-a3286375b27d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:48:05.993407 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-1ab85443-bf96-49b0-91d5-ef5fbf3855d1 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:48:05.993853 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-1ab85443-bf96-49b0-91d5-ef5fbf3855d1 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:48:05.994639 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-1ab85443-bf96-49b0-91d5-ef5fbf3855d1 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:48:05.995072 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-1ab85443-bf96-49b0-91d5-ef5fbf3855d1 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:48:06.015820 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:48:06.129427 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-1ab85443-bf96-49b0-91d5-ef5fbf3855d1 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c963986b46d4d148fc843b0a1183d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:48:06.137095 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-1ab85443-bf96-49b0-91d5-ef5fbf3855d1 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d" status: 200 len: 1519 microversion: 2.1 time: 0.155519 Jun 30 10:48:06.137658 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 422/839] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:48:05 2022] GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:48:06.534952 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-a56b2030-b84b-4767-a2e5-84f456be6415 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:48:06.535446 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-a56b2030-b84b-4767-a2e5-84f456be6415 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 5729f9ae-3c4d-490a-9501-b4806724de9d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:48:06.551321 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a56b2030-b84b-4767-a2e5-84f456be6415 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:48:06.551763 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a56b2030-b84b-4767-a2e5-84f456be6415 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:48:06.552555 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a56b2030-b84b-4767-a2e5-84f456be6415 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:48:06.552992 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a56b2030-b84b-4767-a2e5-84f456be6415 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:48:06.616254 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [req-d155fdc6-9e61-4189-95fb-08ebac1c6eb9 req-0e7666d7-73d8-4e49-a0c5-6ee6146aa85d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "109c8a70-7b89-45b4-8876-a3286375b27d", "name": "network-vif-deleted", "tag": "f447476f-b643-426d-ab27-775f942eaf6e"}]} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:48:06.616570 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-a56b2030-b84b-4767-a2e5-84f456be6415 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:48:06.625464 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-a56b2030-b84b-4767-a2e5-84f456be6415 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/5729f9ae-3c4d-490a-9501-b4806724de9d" status: 200 len: 1300 microversion: 2.1 time: 0.094704 Jun 30 10:48:06.635420 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-d155fdc6-9e61-4189-95fb-08ebac1c6eb9 req-0e7666d7-73d8-4e49-a0c5-6ee6146aa85d service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:48:06.635420 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-d155fdc6-9e61-4189-95fb-08ebac1c6eb9 req-0e7666d7-73d8-4e49-a0c5-6ee6146aa85d service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:48:06.636155 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 418/840] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:48:06 2022] GET /compute/v2.1/servers/5729f9ae-3c4d-490a-9501-b4806724de9d => generated 1300 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:48:06.645235 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.compute.server_external_events [req-d155fdc6-9e61-4189-95fb-08ebac1c6eb9 req-0e7666d7-73d8-4e49-a0c5-6ee6146aa85d service nova] Creating event network-vif-deleted:f447476f-b643-426d-ab27-775f942eaf6e for instance 109c8a70-7b89-45b4-8876-a3286375b27d on hv-cinder-82282 Jun 30 10:48:06.650412 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [req-d155fdc6-9e61-4189-95fb-08ebac1c6eb9 req-0e7666d7-73d8-4e49-a0c5-6ee6146aa85d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040258 Jun 30 10:48:06.651183 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 423/841] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:48:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:48:07.153629 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-fe64a39b-3b5e-47e4-815e-613144216a63 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:48:07.154353 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-fe64a39b-3b5e-47e4-815e-613144216a63 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] [instance: 109c8a70-7b89-45b4-8876-a3286375b27d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:48:07.161104 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-fe64a39b-3b5e-47e4-815e-613144216a63 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:48:07.161625 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-fe64a39b-3b5e-47e4-815e-613144216a63 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:48:07.162454 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-fe64a39b-3b5e-47e4-815e-613144216a63 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:48:07.162962 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-fe64a39b-3b5e-47e4-815e-613144216a63 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:48:07.175989 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.wsgi [None req-fe64a39b-3b5e-47e4-815e-613144216a63 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] HTTP exception thrown: Instance 109c8a70-7b89-45b4-8876-a3286375b27d could not be found. Jun 30 10:48:07.177655 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-fe64a39b-3b5e-47e4-815e-613144216a63 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Request method failure captured: Jun 30 10:48:07.177655 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: request: GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d HTTP/1.1 Jun 30 10:48:07.177655 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Accept: application/json Jun 30 10:48:07.177655 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Accept-Encoding: identity Jun 30 10:48:07.177655 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Connection: close Jun 30 10:48:07.177655 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Content-Length: 0 Jun 30 10:48:07.177655 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Content-Type: application/json Jun 30 10:48:07.177655 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Host: 10.222.0.59 Jun 30 10:48:07.177655 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Openstack-System-Scope: None Jun 30 10:48:07.177655 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: User-Agent: python-urllib3/1.26.9 Jun 30 10:48:07.177655 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Auth-Token: gAAAAABivX2IaMKFb8aVjIO9EozePX71KBEfwyqcUMe3SvB2sa7oqzpACr1t048jevq1HnxAZYOcYQ9yz3sn3Mi-zB8W1WY1FWJvqYQmDU-ufetM9QN3XiPs0N0Ey6_49zVeCFmscnoJJ-2J3rZ2Q476IEMQO-fq6f0WYCxQpJ-MOJQFC-ZWmEU Jun 30 10:48:07.177655 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Domain-Id: None Jun 30 10:48:07.177655 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Domain-Name: None Jun 30 10:48:07.177655 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Identity-Status: Confirmed Jun 30 10:48:07.177655 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Is-Admin-Project: True Jun 30 10:48:07.177655 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Domain-Id: default Jun 30 10:48:07.177655 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Domain-Name: Default Jun 30 10:48:07.177655 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Id: 0e38b1cc4c0d45a8b38ba7b670f83c79 Jun 30 10:48:07.177655 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1656404926 Jun 30 10:48:07.177655 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Role: member,reader Jun 30 10:48:07.177655 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Roles: member,reader Jun 30 10:48:07.178997 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0e38b1cc4c0d45a8b38ba7b670f83c79"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0e38b1cc4c0d45a8b38ba7b670f83c79"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0e38b1cc4c0d45a8b38ba7b670f83c79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0e38b1cc4c0d45a8b38ba7b670f83c79"}]}] Jun 30 10:48:07.178997 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1656404926 Jun 30 10:48:07.178997 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant-Id: 0e38b1cc4c0d45a8b38ba7b670f83c79 Jun 30 10:48:07.178997 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1656404926 Jun 30 10:48:07.178997 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User: tempest-ServerRescueNegativeTestJSON-1656404926-project Jun 30 10:48:07.178997 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Domain-Id: default Jun 30 10:48:07.178997 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Domain-Name: Default Jun 30 10:48:07.178997 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Id: 6c963986b46d4d148fc843b0a1183d69 Jun 30 10:48:07.178997 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1656404926-project Jun 30 10:48:07.178997 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: method: > Jun 30 10:48:07.178997 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: exception: Instance 109c8a70-7b89-45b4-8876-a3286375b27d could not be found. Jun 30 10:48:07.178997 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: action_args: {'id': '109c8a70-7b89-45b4-8876-a3286375b27d'} Jun 30 10:48:07.179754 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:48:07.179754 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:48:07.179754 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 10:48:07.179754 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 10:48:07.179754 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 10:48:07.179754 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 10:48:07.179754 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 10:48:07.179754 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 10:48:07.179754 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 10:48:07.179754 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 10:48:07.179754 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 109c8a70-7b89-45b4-8876-a3286375b27d could not be found. Jun 30 10:48:07.179754 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:48:07.179754 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:48:07.179754 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:48:07.179754 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:48:07.179754 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:48:07.179754 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:48:07.179754 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:48:07.179754 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:48:07.179754 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:48:07.181429 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:48:07.181429 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 10:48:07.181429 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 10:48:07.181429 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 10:48:07.181429 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 10:48:07.181429 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 10:48:07.181429 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:48:07.181429 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 109c8a70-7b89-45b4-8876-a3286375b27d could not be found. Jun 30 10:48:07.181429 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:48:07.181429 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:48:07.181429 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:48:07.181429 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:48:07.181429 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:48:07.181429 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:48:07.181429 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:48:07.181429 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:48:07.181429 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 109c8a70-7b89-45b4-8876-a3286375b27d could not be found. Jun 30 10:48:07.181429 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:48:07.182500 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-fe64a39b-3b5e-47e4-815e-613144216a63 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] Returning 404 to user: Instance 109c8a70-7b89-45b4-8876-a3286375b27d could not be found. {{(pid=124204) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:48:07.182500 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-fe64a39b-3b5e-47e4-815e-613144216a63 tempest-ServerRescueNegativeTestJSON-1656404926 tempest-ServerRescueNegativeTestJSON-1656404926-project] 10.222.0.59 "GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d" status: 404 len: 111 microversion: 2.1 time: 0.029226 Jun 30 10:48:07.182500 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 419/842] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:48:07 2022] GET /compute/v2.1/servers/109c8a70-7b89-45b4-8876-a3286375b27d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 10:48:07.649090 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-6ccc6cdf-cbd5-49b9-b8f7-2235b178767c tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:48:07.650562 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-6ccc6cdf-cbd5-49b9-b8f7-2235b178767c tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 5729f9ae-3c4d-490a-9501-b4806724de9d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:48:07.658239 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-6ccc6cdf-cbd5-49b9-b8f7-2235b178767c tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:48:07.669645 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-6ccc6cdf-cbd5-49b9-b8f7-2235b178767c tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:48:07.670535 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-6ccc6cdf-cbd5-49b9-b8f7-2235b178767c tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:48:07.670980 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-6ccc6cdf-cbd5-49b9-b8f7-2235b178767c tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:48:07.902801 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-6ccc6cdf-cbd5-49b9-b8f7-2235b178767c tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:48:07.912716 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-6ccc6cdf-cbd5-49b9-b8f7-2235b178767c tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/5729f9ae-3c4d-490a-9501-b4806724de9d" status: 200 len: 1367 microversion: 2.1 time: 0.272492 Jun 30 10:48:07.913387 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 424/843] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:48:07 2022] GET /compute/v2.1/servers/5729f9ae-3c4d-490a-9501-b4806724de9d => generated 1367 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:48:08.665148 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [req-9c4d5534-d79c-4f55-899c-383b855e95ed req-831ad4c1-d8af-4edf-bc27-f7690e886a70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5729f9ae-3c4d-490a-9501-b4806724de9d", "tag": "29e0b489-762d-473c-8f72-86220ad3e1e4"}]} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:48:08.675064 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-9c4d5534-d79c-4f55-899c-383b855e95ed req-831ad4c1-d8af-4edf-bc27-f7690e886a70 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:48:08.675861 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-9c4d5534-d79c-4f55-899c-383b855e95ed req-831ad4c1-d8af-4edf-bc27-f7690e886a70 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:48:08.688900 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.compute.server_external_events [req-9c4d5534-d79c-4f55-899c-383b855e95ed req-831ad4c1-d8af-4edf-bc27-f7690e886a70 service nova] Creating event network-changed:29e0b489-762d-473c-8f72-86220ad3e1e4 for instance 5729f9ae-3c4d-490a-9501-b4806724de9d on hv-cinder-82282 Jun 30 10:48:08.693972 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [req-9c4d5534-d79c-4f55-899c-383b855e95ed req-831ad4c1-d8af-4edf-bc27-f7690e886a70 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032390 Jun 30 10:48:08.694841 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 420/844] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:48:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:48:08.930476 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-4e378e1f-8eb4-4b2c-8939-681295906251 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:48:08.931235 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-4e378e1f-8eb4-4b2c-8939-681295906251 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 5729f9ae-3c4d-490a-9501-b4806724de9d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:48:08.938189 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-4e378e1f-8eb4-4b2c-8939-681295906251 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:48:08.938637 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-4e378e1f-8eb4-4b2c-8939-681295906251 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:48:08.939395 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-4e378e1f-8eb4-4b2c-8939-681295906251 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:48:08.939827 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-4e378e1f-8eb4-4b2c-8939-681295906251 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:48:09.137175 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-4e378e1f-8eb4-4b2c-8939-681295906251 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:48:09.146206 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-4e378e1f-8eb4-4b2c-8939-681295906251 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/5729f9ae-3c4d-490a-9501-b4806724de9d" status: 200 len: 1367 microversion: 2.1 time: 0.219488 Jun 30 10:48:09.146844 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 425/845] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:48:08 2022] GET /compute/v2.1/servers/5729f9ae-3c4d-490a-9501-b4806724de9d => generated 1367 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:48:10.164456 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-256472a8-ec44-45ea-a42c-e8442a63cce6 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:48:10.165305 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-256472a8-ec44-45ea-a42c-e8442a63cce6 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 5729f9ae-3c4d-490a-9501-b4806724de9d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:48:10.171514 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-256472a8-ec44-45ea-a42c-e8442a63cce6 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:48:10.172050 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-256472a8-ec44-45ea-a42c-e8442a63cce6 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:48:10.172921 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-256472a8-ec44-45ea-a42c-e8442a63cce6 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:48:10.173454 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-256472a8-ec44-45ea-a42c-e8442a63cce6 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:48:10.380696 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-256472a8-ec44-45ea-a42c-e8442a63cce6 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:48:10.388219 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-256472a8-ec44-45ea-a42c-e8442a63cce6 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/5729f9ae-3c4d-490a-9501-b4806724de9d" status: 200 len: 1367 microversion: 2.1 time: 0.228644 Jun 30 10:48:10.388875 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 421/846] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:48:10 2022] GET /compute/v2.1/servers/5729f9ae-3c4d-490a-9501-b4806724de9d => generated 1367 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:48:11.406890 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-5e556122-7291-41d9-938d-835d8e5645b5 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:48:11.407540 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-5e556122-7291-41d9-938d-835d8e5645b5 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 5729f9ae-3c4d-490a-9501-b4806724de9d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:48:11.414928 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-5e556122-7291-41d9-938d-835d8e5645b5 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:48:11.415366 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-5e556122-7291-41d9-938d-835d8e5645b5 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:48:11.416145 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-5e556122-7291-41d9-938d-835d8e5645b5 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:48:11.416646 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-5e556122-7291-41d9-938d-835d8e5645b5 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:48:11.562369 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-5e556122-7291-41d9-938d-835d8e5645b5 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:48:11.574224 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-5e556122-7291-41d9-938d-835d8e5645b5 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/5729f9ae-3c4d-490a-9501-b4806724de9d" status: 200 len: 1367 microversion: 2.1 time: 0.172006 Jun 30 10:48:11.574820 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 426/847] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:48:11 2022] GET /compute/v2.1/servers/5729f9ae-3c4d-490a-9501-b4806724de9d => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:48:12.590975 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-5cc8af64-8a63-4735-82b3-f6bd3b8f65eb tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:48:12.591593 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-5cc8af64-8a63-4735-82b3-f6bd3b8f65eb tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 5729f9ae-3c4d-490a-9501-b4806724de9d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:48:12.598222 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5cc8af64-8a63-4735-82b3-f6bd3b8f65eb tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:48:12.598607 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5cc8af64-8a63-4735-82b3-f6bd3b8f65eb tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:48:12.599373 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5cc8af64-8a63-4735-82b3-f6bd3b8f65eb tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:48:12.599813 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5cc8af64-8a63-4735-82b3-f6bd3b8f65eb tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:48:12.744564 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-5cc8af64-8a63-4735-82b3-f6bd3b8f65eb tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:48:12.753456 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-5cc8af64-8a63-4735-82b3-f6bd3b8f65eb tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/5729f9ae-3c4d-490a-9501-b4806724de9d" status: 200 len: 1367 microversion: 2.1 time: 0.166224 Jun 30 10:48:12.754139 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 422/848] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:48:12 2022] GET /compute/v2.1/servers/5729f9ae-3c4d-490a-9501-b4806724de9d => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:48:13.770527 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-689d2fc9-c147-4a81-ad35-73048d35a22e tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:48:13.771226 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-689d2fc9-c147-4a81-ad35-73048d35a22e tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 5729f9ae-3c4d-490a-9501-b4806724de9d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:48:13.773229 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_cell0:SELECT=2 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:48:13.774017 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_cell0:SELECT=6 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:48:13.781158 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-689d2fc9-c147-4a81-ad35-73048d35a22e tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:48:13.781605 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-689d2fc9-c147-4a81-ad35-73048d35a22e tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:48:13.782363 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-689d2fc9-c147-4a81-ad35-73048d35a22e tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:48:13.782796 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-689d2fc9-c147-4a81-ad35-73048d35a22e tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:48:13.908374 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-689d2fc9-c147-4a81-ad35-73048d35a22e tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:48:13.915824 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-689d2fc9-c147-4a81-ad35-73048d35a22e tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/5729f9ae-3c4d-490a-9501-b4806724de9d" status: 200 len: 1367 microversion: 2.1 time: 0.149133 Jun 30 10:48:13.916381 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 427/849] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:48:13 2022] GET /compute/v2.1/servers/5729f9ae-3c4d-490a-9501-b4806724de9d => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:48:14.366446 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [req-e1fc0981-159a-4135-809e-b6a402ba5313 req-ef03376e-3282-435c-a7e6-f438768a7353 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5729f9ae-3c4d-490a-9501-b4806724de9d", "name": "network-vif-plugged", "status": "completed", "tag": "29e0b489-762d-473c-8f72-86220ad3e1e4"}]} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:48:14.371204 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_cell0:SELECT=6 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:48:14.377248 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-e1fc0981-159a-4135-809e-b6a402ba5313 req-ef03376e-3282-435c-a7e6-f438768a7353 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:48:14.378611 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-e1fc0981-159a-4135-809e-b6a402ba5313 req-ef03376e-3282-435c-a7e6-f438768a7353 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:48:14.390193 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.compute.server_external_events [req-e1fc0981-159a-4135-809e-b6a402ba5313 req-ef03376e-3282-435c-a7e6-f438768a7353 service nova] Creating event network-vif-plugged:29e0b489-762d-473c-8f72-86220ad3e1e4 for instance 5729f9ae-3c4d-490a-9501-b4806724de9d on hv-cinder-82282 Jun 30 10:48:14.394964 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [req-e1fc0981-159a-4135-809e-b6a402ba5313 req-ef03376e-3282-435c-a7e6-f438768a7353 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032409 Jun 30 10:48:14.395596 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 423/850] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:48:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:48:14.932385 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-e712039f-32d9-4483-81fb-46e737fbdd7e tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:48:14.932957 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-e712039f-32d9-4483-81fb-46e737fbdd7e tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 5729f9ae-3c4d-490a-9501-b4806724de9d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:48:14.939735 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e712039f-32d9-4483-81fb-46e737fbdd7e tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:48:14.940179 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e712039f-32d9-4483-81fb-46e737fbdd7e tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:48:14.940956 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e712039f-32d9-4483-81fb-46e737fbdd7e tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:48:14.941384 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e712039f-32d9-4483-81fb-46e737fbdd7e tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:48:15.071594 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-e712039f-32d9-4483-81fb-46e737fbdd7e tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:48:15.079574 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-e712039f-32d9-4483-81fb-46e737fbdd7e tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/5729f9ae-3c4d-490a-9501-b4806724de9d" status: 200 len: 1367 microversion: 2.1 time: 0.151150 Jun 30 10:48:15.080139 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 428/851] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:48:14 2022] GET /compute/v2.1/servers/5729f9ae-3c4d-490a-9501-b4806724de9d => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:48:16.097836 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-8e2859eb-d78e-4f7f-8e62-1eaabb42eb20 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:48:16.098560 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-8e2859eb-d78e-4f7f-8e62-1eaabb42eb20 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 5729f9ae-3c4d-490a-9501-b4806724de9d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:48:16.105233 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-8e2859eb-d78e-4f7f-8e62-1eaabb42eb20 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:48:16.105676 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-8e2859eb-d78e-4f7f-8e62-1eaabb42eb20 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:48:16.106430 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-8e2859eb-d78e-4f7f-8e62-1eaabb42eb20 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:48:16.106862 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-8e2859eb-d78e-4f7f-8e62-1eaabb42eb20 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:48:16.237023 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-8e2859eb-d78e-4f7f-8e62-1eaabb42eb20 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:48:16.244438 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-8e2859eb-d78e-4f7f-8e62-1eaabb42eb20 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/5729f9ae-3c4d-490a-9501-b4806724de9d" status: 200 len: 1367 microversion: 2.1 time: 0.150762 Jun 30 10:48:16.245027 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 424/852] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:48:16 2022] GET /compute/v2.1/servers/5729f9ae-3c4d-490a-9501-b4806724de9d => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:48:17.261377 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-0b9953fc-8fe6-4920-abf3-8fffe5fe2159 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:48:17.262014 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-0b9953fc-8fe6-4920-abf3-8fffe5fe2159 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 5729f9ae-3c4d-490a-9501-b4806724de9d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:48:17.268549 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0b9953fc-8fe6-4920-abf3-8fffe5fe2159 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:48:17.268999 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0b9953fc-8fe6-4920-abf3-8fffe5fe2159 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:48:17.269755 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0b9953fc-8fe6-4920-abf3-8fffe5fe2159 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:48:17.270186 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0b9953fc-8fe6-4920-abf3-8fffe5fe2159 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:48:17.394861 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-0b9953fc-8fe6-4920-abf3-8fffe5fe2159 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:48:17.402183 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-0b9953fc-8fe6-4920-abf3-8fffe5fe2159 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/5729f9ae-3c4d-490a-9501-b4806724de9d" status: 200 len: 1367 microversion: 2.1 time: 0.144707 Jun 30 10:48:17.402756 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 429/853] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:48:17 2022] GET /compute/v2.1/servers/5729f9ae-3c4d-490a-9501-b4806724de9d => generated 1367 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:48:18.419117 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-ea8c8ae8-6e40-44cb-8fd6-11b2a3446d39 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:48:18.419729 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-ea8c8ae8-6e40-44cb-8fd6-11b2a3446d39 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 5729f9ae-3c4d-490a-9501-b4806724de9d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:48:18.426818 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ea8c8ae8-6e40-44cb-8fd6-11b2a3446d39 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:48:18.427271 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ea8c8ae8-6e40-44cb-8fd6-11b2a3446d39 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:48:18.428036 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ea8c8ae8-6e40-44cb-8fd6-11b2a3446d39 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:48:18.428474 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ea8c8ae8-6e40-44cb-8fd6-11b2a3446d39 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:48:18.557700 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-ea8c8ae8-6e40-44cb-8fd6-11b2a3446d39 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:48:18.565767 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-ea8c8ae8-6e40-44cb-8fd6-11b2a3446d39 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/5729f9ae-3c4d-490a-9501-b4806724de9d" status: 200 len: 1367 microversion: 2.1 time: 0.150530 Jun 30 10:48:18.566328 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 425/854] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:48:18 2022] GET /compute/v2.1/servers/5729f9ae-3c4d-490a-9501-b4806724de9d => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:48:19.583611 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-0959a3a7-f81a-4b24-bcdc-93a92ea7f045 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:48:19.584224 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-0959a3a7-f81a-4b24-bcdc-93a92ea7f045 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 5729f9ae-3c4d-490a-9501-b4806724de9d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:48:19.590653 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0959a3a7-f81a-4b24-bcdc-93a92ea7f045 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:48:19.591095 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0959a3a7-f81a-4b24-bcdc-93a92ea7f045 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:48:19.591842 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0959a3a7-f81a-4b24-bcdc-93a92ea7f045 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:48:19.592317 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0959a3a7-f81a-4b24-bcdc-93a92ea7f045 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:48:19.723315 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-0959a3a7-f81a-4b24-bcdc-93a92ea7f045 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:48:19.730703 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-0959a3a7-f81a-4b24-bcdc-93a92ea7f045 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/5729f9ae-3c4d-490a-9501-b4806724de9d" status: 200 len: 1367 microversion: 2.1 time: 0.150983 Jun 30 10:48:19.731267 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 430/855] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:48:19 2022] GET /compute/v2.1/servers/5729f9ae-3c4d-490a-9501-b4806724de9d => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:48:20.747048 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-052cfeec-7302-4e81-93e5-19e74dcab291 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:48:20.747758 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-052cfeec-7302-4e81-93e5-19e74dcab291 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 5729f9ae-3c4d-490a-9501-b4806724de9d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:48:20.749750 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:48:20.755227 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-052cfeec-7302-4e81-93e5-19e74dcab291 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:48:20.755731 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-052cfeec-7302-4e81-93e5-19e74dcab291 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:48:20.756414 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-052cfeec-7302-4e81-93e5-19e74dcab291 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:48:20.756949 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-052cfeec-7302-4e81-93e5-19e74dcab291 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:48:20.891423 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-052cfeec-7302-4e81-93e5-19e74dcab291 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:48:20.899113 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-052cfeec-7302-4e81-93e5-19e74dcab291 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/5729f9ae-3c4d-490a-9501-b4806724de9d" status: 200 len: 1558 microversion: 2.1 time: 0.155983 Jun 30 10:48:20.899772 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 426/856] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:48:20 2022] GET /compute/v2.1/servers/5729f9ae-3c4d-490a-9501-b4806724de9d => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:48:20.916166 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-4b6e1b64-c5e0-43bc-9086-9d7e910aaf3e tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:48:20.916761 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-4b6e1b64-c5e0-43bc-9086-9d7e910aaf3e tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 5729f9ae-3c4d-490a-9501-b4806724de9d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:48:20.918955 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=3,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:48:20.924968 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-4b6e1b64-c5e0-43bc-9086-9d7e910aaf3e tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:48:20.925435 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-4b6e1b64-c5e0-43bc-9086-9d7e910aaf3e tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:48:20.926183 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-4b6e1b64-c5e0-43bc-9086-9d7e910aaf3e tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:48:20.926617 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-4b6e1b64-c5e0-43bc-9086-9d7e910aaf3e tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:48:21.009673 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-4b6e1b64-c5e0-43bc-9086-9d7e910aaf3e tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/5729f9ae-3c4d-490a-9501-b4806724de9d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097504 Jun 30 10:48:21.010285 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 431/857] 10.222.0.59 () {58 vars in 1274 bytes} [Thu Jun 30 10:48:20 2022] GET /compute/v2.1/servers/5729f9ae-3c4d-490a-9501-b4806724de9d/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:48:22.119258 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [req-5e471cb7-0ef0-4318-8421-427423808d98 req-e5ccb887-5499-4cc8-a970-96217077dcbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5729f9ae-3c4d-490a-9501-b4806724de9d", "tag": "29e0b489-762d-473c-8f72-86220ad3e1e4"}]} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:48:22.128915 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-5e471cb7-0ef0-4318-8421-427423808d98 req-e5ccb887-5499-4cc8-a970-96217077dcbf service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:48:22.129439 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-5e471cb7-0ef0-4318-8421-427423808d98 req-e5ccb887-5499-4cc8-a970-96217077dcbf service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:48:22.146421 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.compute.server_external_events [req-5e471cb7-0ef0-4318-8421-427423808d98 req-e5ccb887-5499-4cc8-a970-96217077dcbf service nova] Creating event network-changed:29e0b489-762d-473c-8f72-86220ad3e1e4 for instance 5729f9ae-3c4d-490a-9501-b4806724de9d on hv-cinder-82282 Jun 30 10:48:22.151482 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [req-5e471cb7-0ef0-4318-8421-427423808d98 req-e5ccb887-5499-4cc8-a970-96217077dcbf service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035937 Jun 30 10:48:22.152313 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 427/858] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:48:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:49:01.727477 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_cell1:SELECT=50 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:49:01.728199 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_api:SELECT=1 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:49:01.732994 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-c5b101f9-af1b-4cbf-b811-5a3bd8bf1f08 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:49:01.733916 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-c5b101f9-af1b-4cbf-b811-5a3bd8bf1f08 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:49:01.741283 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c5b101f9-af1b-4cbf-b811-5a3bd8bf1f08 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:01.741732 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c5b101f9-af1b-4cbf-b811-5a3bd8bf1f08 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:01.742494 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c5b101f9-af1b-4cbf-b811-5a3bd8bf1f08 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:01.742932 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c5b101f9-af1b-4cbf-b811-5a3bd8bf1f08 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:01.771697 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-c5b101f9-af1b-4cbf-b811-5a3bd8bf1f08 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045707 Jun 30 10:49:01.772293 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 432/859] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 30 10:49:01 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 30 10:49:01.829055 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-dae0c9d4-cf01-4bd2-a06c-34bafffa0f11 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:49:01.829680 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-dae0c9d4-cf01-4bd2-a06c-34bafffa0f11 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:49:01.831774 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_api:SELECT=3 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:49:01.832428 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_cell1:SELECT=46 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:49:01.838798 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-dae0c9d4-cf01-4bd2-a06c-34bafffa0f11 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:01.839239 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-dae0c9d4-cf01-4bd2-a06c-34bafffa0f11 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:01.839999 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-dae0c9d4-cf01-4bd2-a06c-34bafffa0f11 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:01.840433 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-dae0c9d4-cf01-4bd2-a06c-34bafffa0f11 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:01.865078 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-dae0c9d4-cf01-4bd2-a06c-34bafffa0f11 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Going to try to terminate instance {{(pid=124204) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 10:49:01.943338 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-dae0c9d4-cf01-4bd2-a06c-34bafffa0f11 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "DELETE /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 204 len: 0 microversion: 2.1 time: 0.118344 Jun 30 10:49:01.948262 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 428/860] 10.222.0.59 () {58 vars in 1238 bytes} [Thu Jun 30 10:49:01 2022] DELETE /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 30 10:49:01.958210 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-3790b5af-2bd0-400d-a5d5-c3111714b81f tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:49:01.958811 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-3790b5af-2bd0-400d-a5d5-c3111714b81f tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:49:01.964794 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-3790b5af-2bd0-400d-a5d5-c3111714b81f tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:01.965238 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-3790b5af-2bd0-400d-a5d5-c3111714b81f tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:01.965999 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-3790b5af-2bd0-400d-a5d5-c3111714b81f tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:01.966423 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-3790b5af-2bd0-400d-a5d5-c3111714b81f tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:02.105905 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-3790b5af-2bd0-400d-a5d5-c3111714b81f tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:02.114865 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-3790b5af-2bd0-400d-a5d5-c3111714b81f tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1673 microversion: 2.1 time: 0.165392 Jun 30 10:49:02.115752 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 433/861] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:49:01 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1673 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:49:03.134636 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-3328139f-e2b1-4e40-a05e-1d1ae2accf4a tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:49:03.135326 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-3328139f-e2b1-4e40-a05e-1d1ae2accf4a tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:49:03.141746 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-3328139f-e2b1-4e40-a05e-1d1ae2accf4a tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:03.142188 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-3328139f-e2b1-4e40-a05e-1d1ae2accf4a tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:03.143562 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-3328139f-e2b1-4e40-a05e-1d1ae2accf4a tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:03.143998 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-3328139f-e2b1-4e40-a05e-1d1ae2accf4a tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:03.272040 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-3328139f-e2b1-4e40-a05e-1d1ae2accf4a tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:03.280439 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-3328139f-e2b1-4e40-a05e-1d1ae2accf4a tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1673 microversion: 2.1 time: 0.149861 Jun 30 10:49:03.281124 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 429/862] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:49:03 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1673 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:49:04.119907 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [req-cac259f9-ae88-4d05-b9af-88ddab8a38b1 req-a331f3de-d1d7-4028-9392-a43c63443d05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8379d7c-c539-4cb8-9c06-886aff24e725", "name": "network-vif-deleted", "tag": "4d656245-ccde-4b1f-a74a-7077e762ec01"}]} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:49:04.132712 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-cac259f9-ae88-4d05-b9af-88ddab8a38b1 req-a331f3de-d1d7-4028-9392-a43c63443d05 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:04.133154 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-cac259f9-ae88-4d05-b9af-88ddab8a38b1 req-a331f3de-d1d7-4028-9392-a43c63443d05 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:04.148250 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.compute.server_external_events [req-cac259f9-ae88-4d05-b9af-88ddab8a38b1 req-a331f3de-d1d7-4028-9392-a43c63443d05 service nova] Creating event network-vif-deleted:4d656245-ccde-4b1f-a74a-7077e762ec01 for instance a8379d7c-c539-4cb8-9c06-886aff24e725 on hv-cinder-82282 Jun 30 10:49:04.154429 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [req-cac259f9-ae88-4d05-b9af-88ddab8a38b1 req-a331f3de-d1d7-4028-9392-a43c63443d05 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038489 Jun 30 10:49:04.155657 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 434/863] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:49:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:49:04.299140 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-29c1dd03-dfa3-4e7d-a1a2-29def10b7221 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:49:04.299761 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-29c1dd03-dfa3-4e7d-a1a2-29def10b7221 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:49:04.306780 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-29c1dd03-dfa3-4e7d-a1a2-29def10b7221 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:04.307412 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-29c1dd03-dfa3-4e7d-a1a2-29def10b7221 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:04.308205 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-29c1dd03-dfa3-4e7d-a1a2-29def10b7221 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:04.308701 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-29c1dd03-dfa3-4e7d-a1a2-29def10b7221 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:04.346005 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-29c1dd03-dfa3-4e7d-a1a2-29def10b7221 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:04.346457 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-29c1dd03-dfa3-4e7d-a1a2-29def10b7221 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:04.347082 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.objects.instance [None req-29c1dd03-dfa3-4e7d-a1a2-29def10b7221 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lazy-loading 'fault' on Instance uuid a8379d7c-c539-4cb8-9c06-886aff24e725 {{(pid=124204) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 10:49:04.396542 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-29c1dd03-dfa3-4e7d-a1a2-29def10b7221 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:04.416042 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-29c1dd03-dfa3-4e7d-a1a2-29def10b7221 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 200 len: 1327 microversion: 2.1 time: 0.122097 Jun 30 10:49:04.416716 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 430/864] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:49:04 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 1327 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:49:05.434226 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-e582b5b9-f11c-4d52-8a17-f15cb1a18ea9 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:49:05.434926 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-e582b5b9-f11c-4d52-8a17-f15cb1a18ea9 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:49:05.442190 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e582b5b9-f11c-4d52-8a17-f15cb1a18ea9 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:05.442635 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e582b5b9-f11c-4d52-8a17-f15cb1a18ea9 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:05.443392 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e582b5b9-f11c-4d52-8a17-f15cb1a18ea9 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:05.443826 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e582b5b9-f11c-4d52-8a17-f15cb1a18ea9 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:05.456634 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.wsgi [None req-e582b5b9-f11c-4d52-8a17-f15cb1a18ea9 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] HTTP exception thrown: Instance a8379d7c-c539-4cb8-9c06-886aff24e725 could not be found. Jun 30 10:49:05.458200 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-e582b5b9-f11c-4d52-8a17-f15cb1a18ea9 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Request method failure captured: Jun 30 10:49:05.458200 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: request: GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 HTTP/1.1 Jun 30 10:49:05.458200 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Accept: application/json Jun 30 10:49:05.458200 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Accept-Encoding: identity Jun 30 10:49:05.458200 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Connection: close Jun 30 10:49:05.458200 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Content-Length: 0 Jun 30 10:49:05.458200 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Content-Type: application/json Jun 30 10:49:05.458200 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Host: 10.222.0.59 Jun 30 10:49:05.458200 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Openstack-System-Scope: None Jun 30 10:49:05.458200 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: User-Agent: python-urllib3/1.26.9 Jun 30 10:49:05.458200 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Auth-Token: gAAAAABivX2Niq6wdQ7smNPbNgMJixqD93gm_JdHSeM_07D1r2ozq1nvPz3nujMo4LpG5EX0oiCjpRShKTd5m0cJ9kBrFk3AhfzWQI4BShG3yU7psx5JbedGKreTDypMQfUlQaDulTx9u_Ipu3kVqOCu-ywbUNZurPgDkaZXPZGk4COYXV4hzeE Jun 30 10:49:05.458200 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Domain-Id: None Jun 30 10:49:05.458200 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Domain-Name: None Jun 30 10:49:05.458200 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Identity-Status: Confirmed Jun 30 10:49:05.458200 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Is-Admin-Project: True Jun 30 10:49:05.458200 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Domain-Id: default Jun 30 10:49:05.458200 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Domain-Name: Default Jun 30 10:49:05.458200 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Id: a531892a5f9e4964aa9b35519ad72b68 Jun 30 10:49:05.458200 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Name: tempest-AttachVolumeTestJSON-815828120 Jun 30 10:49:05.458200 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Role: member,reader Jun 30 10:49:05.458200 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Roles: member,reader Jun 30 10:49:05.459805 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/a531892a5f9e4964aa9b35519ad72b68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_a531892a5f9e4964aa9b35519ad72b68"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a531892a5f9e4964aa9b35519ad72b68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a531892a5f9e4964aa9b35519ad72b68"}]}] Jun 30 10:49:05.459805 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant: tempest-AttachVolumeTestJSON-815828120 Jun 30 10:49:05.459805 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant-Id: a531892a5f9e4964aa9b35519ad72b68 Jun 30 10:49:05.459805 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant-Name: tempest-AttachVolumeTestJSON-815828120 Jun 30 10:49:05.459805 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User: tempest-AttachVolumeTestJSON-815828120-project Jun 30 10:49:05.459805 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Domain-Id: default Jun 30 10:49:05.459805 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Domain-Name: Default Jun 30 10:49:05.459805 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Id: 131fb3808ea341618e17256b43862937 Jun 30 10:49:05.459805 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Name: tempest-AttachVolumeTestJSON-815828120-project Jun 30 10:49:05.459805 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: method: > Jun 30 10:49:05.459805 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: exception: Instance a8379d7c-c539-4cb8-9c06-886aff24e725 could not be found. Jun 30 10:49:05.459805 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: action_args: {'id': 'a8379d7c-c539-4cb8-9c06-886aff24e725'} Jun 30 10:49:05.460671 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:49:05.460671 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:49:05.460671 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 10:49:05.460671 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 10:49:05.460671 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 10:49:05.460671 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 10:49:05.460671 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 10:49:05.460671 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 10:49:05.460671 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 10:49:05.460671 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 10:49:05.460671 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8379d7c-c539-4cb8-9c06-886aff24e725 could not be found. Jun 30 10:49:05.460671 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:49:05.460671 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:49:05.460671 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:49:05.460671 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:49:05.460671 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:49:05.460671 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:49:05.460671 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:49:05.460671 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:49:05.460671 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:49:05.462280 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:49:05.462280 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 10:49:05.462280 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 10:49:05.462280 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 10:49:05.462280 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 10:49:05.462280 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 10:49:05.462280 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:49:05.462280 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8379d7c-c539-4cb8-9c06-886aff24e725 could not be found. Jun 30 10:49:05.462280 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:49:05.462280 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:49:05.462280 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:49:05.462280 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:49:05.462280 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:49:05.462280 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:49:05.462280 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:49:05.462280 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:49:05.462280 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8379d7c-c539-4cb8-9c06-886aff24e725 could not be found. Jun 30 10:49:05.462280 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:49:05.464241 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-e582b5b9-f11c-4d52-8a17-f15cb1a18ea9 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Returning 404 to user: Instance a8379d7c-c539-4cb8-9c06-886aff24e725 could not be found. {{(pid=124203) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:49:05.464241 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-e582b5b9-f11c-4d52-8a17-f15cb1a18ea9 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 404 len: 111 microversion: 2.1 time: 0.029567 Jun 30 10:49:05.464241 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 435/865] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:49:05 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 10:49:05.468409 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-8eb47cd9-d7aa-4391-895b-2c40fdc828c7 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '.version_select at 0x7f4dadcb8670>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:49:05.485171 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-8eb47cd9-d7aa-4391-895b-2c40fdc828c7 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-399491739" status: 202 len: 0 microversion: 2.1 time: 0.020531 Jun 30 10:49:05.485722 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 431/866] 10.222.0.59 () {58 vars in 1217 bytes} [Thu Jun 30 10:49:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-399491739 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 10:49:06.112934 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-26d39c11-4eb9-4388-a531-7aac01a9e25d tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Action: 'create', calling method: .version_select at 0x7f4db25790d0>, body: {"keypair": {"name": "tempest-keypair-831061114", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFaG6PIXDNV3wJlEXODG6WMNZ+Zm/E9bwbj5iolaxZ8GS+bmCtc9C446e5T8e5/Vps/qXpVp1Du0h0CcMXG9424lX0rFsaG1Lt5PBeUIdQmOJHTWdaDn38n0uYVgSn9eBA=="}} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:49:06.128187 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.quota [None req-26d39c11-4eb9-4388-a531-7aac01a9e25d tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Getting quotas for project a531892a5f9e4964aa9b35519ad72b68. Resources: {'key_pairs'} {{(pid=124203) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 10:49:06.132156 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.quota [None req-26d39c11-4eb9-4388-a531-7aac01a9e25d tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Getting quotas for user 131fb3808ea341618e17256b43862937 and project a531892a5f9e4964aa9b35519ad72b68. Resources: {'key_pairs'} {{(pid=124203) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 10:49:06.154977 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-26d39c11-4eb9-4388-a531-7aac01a9e25d tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045746 Jun 30 10:49:06.155601 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 436/867] 10.222.0.59 () {60 vars in 1158 bytes} [Thu Jun 30 10:49:06 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:49:07.422820 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-b1d783ed-5f88-47a5-afb6-8c1f91e623f0 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-730317912", "imageRef": "c473bd04-5a45-4eb7-b6f4-2b5033d4fc1d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "495998d3-6741-43d1-b79b-1335d3468e40"}], "security_groups": [{"name": "tempest-securitygroup--1499715453"}], "key_name": "tempest-keypair-831061114", "user_data": "}} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:49:07.527326 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.network.neutron [None req-b1d783ed-5f88-47a5-afb6-8c1f91e623f0 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] validate_networks() for [('495998d3-6741-43d1-b79b-1335d3468e40', None, None, None, None, None)] {{(pid=124204) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 10:49:07.924277 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.virt.hardware [None req-b1d783ed-5f88-47a5-afb6-8c1f91e623f0 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Flavor limits 0:0:0 {{(pid=124204) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 10:49:07.924741 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.virt.hardware [None req-b1d783ed-5f88-47a5-afb6-8c1f91e623f0 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Image limits 0:0:0 {{(pid=124204) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 10:49:07.925737 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.virt.hardware [None req-b1d783ed-5f88-47a5-afb6-8c1f91e623f0 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Flavor pref 0:0:0 {{(pid=124204) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 10:49:07.926149 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.virt.hardware [None req-b1d783ed-5f88-47a5-afb6-8c1f91e623f0 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Image pref 0:0:0 {{(pid=124204) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 10:49:07.926556 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.virt.hardware [None req-b1d783ed-5f88-47a5-afb6-8c1f91e623f0 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124204) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 10:49:07.935624 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-b1d783ed-5f88-47a5-afb6-8c1f91e623f0 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:07.936064 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-b1d783ed-5f88-47a5-afb6-8c1f91e623f0 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:07.936903 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-b1d783ed-5f88-47a5-afb6-8c1f91e623f0 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:07.937337 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-b1d783ed-5f88-47a5-afb6-8c1f91e623f0 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:07.955748 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.quota [None req-b1d783ed-5f88-47a5-afb6-8c1f91e623f0 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Getting quotas for project a531892a5f9e4964aa9b35519ad72b68. Resources: {'instances', 'cores', 'ram'} {{(pid=124204) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 10:49:07.959780 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.quota [None req-b1d783ed-5f88-47a5-afb6-8c1f91e623f0 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Getting quotas for user 131fb3808ea341618e17256b43862937 and project a531892a5f9e4964aa9b35519ad72b68. Resources: {'instances', 'cores', 'ram'} {{(pid=124204) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 10:49:07.970689 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-b1d783ed-5f88-47a5-afb6-8c1f91e623f0 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Going to run 1 instances... {{(pid=124204) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 10:49:07.973342 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-b1d783ed-5f88-47a5-afb6-8c1f91e623f0 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: 4ea0da70-2dc2-464e-8b2d-747cb81fed14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c473bd04-5a45-4eb7-b6f4-2b5033d4fc1d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124204) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 10:49:08.025617 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-b1d783ed-5f88-47a5-afb6-8c1f91e623f0 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.607814 Jun 30 10:49:08.026454 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 432/868] 10.222.0.59 () {60 vars in 1146 bytes} [Thu Jun 30 10:49:07 2022] POST /compute/v2.1/servers => generated 402 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 10:49:08.037067 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-6c7c1c43-38db-4efc-be94-3cd67fe73156 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:49:08.037706 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-6c7c1c43-38db-4efc-be94-3cd67fe73156 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: 4ea0da70-2dc2-464e-8b2d-747cb81fed14] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:49:08.093749 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-6c7c1c43-38db-4efc-be94-3cd67fe73156 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:08.101088 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-6c7c1c43-38db-4efc-be94-3cd67fe73156 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/4ea0da70-2dc2-464e-8b2d-747cb81fed14" status: 200 len: 1236 microversion: 2.1 time: 0.068746 Jun 30 10:49:08.102168 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 437/869] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:49:08 2022] GET /compute/v2.1/servers/4ea0da70-2dc2-464e-8b2d-747cb81fed14 => generated 1236 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:49:09.118935 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-45bb0fd3-b60e-49ef-801f-2884861360cb tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:49:09.120325 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-45bb0fd3-b60e-49ef-801f-2884861360cb tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: 4ea0da70-2dc2-464e-8b2d-747cb81fed14] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:49:09.143809 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-45bb0fd3-b60e-49ef-801f-2884861360cb tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:09.144298 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-45bb0fd3-b60e-49ef-801f-2884861360cb tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:09.145102 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-45bb0fd3-b60e-49ef-801f-2884861360cb tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:09.146781 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-45bb0fd3-b60e-49ef-801f-2884861360cb tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:09.226752 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-45bb0fd3-b60e-49ef-801f-2884861360cb tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:09.235234 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-45bb0fd3-b60e-49ef-801f-2884861360cb tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/4ea0da70-2dc2-464e-8b2d-747cb81fed14" status: 200 len: 1294 microversion: 2.1 time: 0.120597 Jun 30 10:49:09.235848 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 433/870] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:49:09 2022] GET /compute/v2.1/servers/4ea0da70-2dc2-464e-8b2d-747cb81fed14 => generated 1294 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:49:10.258975 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-5d046ee7-2421-4e28-8aa6-ec5a80793581 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:49:10.259732 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-5d046ee7-2421-4e28-8aa6-ec5a80793581 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: 4ea0da70-2dc2-464e-8b2d-747cb81fed14] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:49:10.268609 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-5d046ee7-2421-4e28-8aa6-ec5a80793581 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:10.269957 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-5d046ee7-2421-4e28-8aa6-ec5a80793581 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:10.271027 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-5d046ee7-2421-4e28-8aa6-ec5a80793581 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:10.272339 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-5d046ee7-2421-4e28-8aa6-ec5a80793581 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:10.325839 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [req-d91affc3-c643-42ec-b661-b55c2b585e40 req-d86bb669-55c3-4dd2-b1a0-b35901e6aff7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ea0da70-2dc2-464e-8b2d-747cb81fed14", "tag": "e406871b-4573-46e9-a343-7939230a9d1a"}]} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:49:10.346374 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-d91affc3-c643-42ec-b661-b55c2b585e40 req-d86bb669-55c3-4dd2-b1a0-b35901e6aff7 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:10.346594 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-d91affc3-c643-42ec-b661-b55c2b585e40 req-d86bb669-55c3-4dd2-b1a0-b35901e6aff7 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:10.369641 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.compute.server_external_events [req-d91affc3-c643-42ec-b661-b55c2b585e40 req-d86bb669-55c3-4dd2-b1a0-b35901e6aff7 service nova] Creating event network-changed:e406871b-4573-46e9-a343-7939230a9d1a for instance 4ea0da70-2dc2-464e-8b2d-747cb81fed14 on hv-cinder-82282 Jun 30 10:49:10.376481 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [req-d91affc3-c643-42ec-b661-b55c2b585e40 req-d86bb669-55c3-4dd2-b1a0-b35901e6aff7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054322 Jun 30 10:49:10.377119 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 434/871] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:49:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 10:49:10.465881 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-5d046ee7-2421-4e28-8aa6-ec5a80793581 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:10.474139 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-5d046ee7-2421-4e28-8aa6-ec5a80793581 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/4ea0da70-2dc2-464e-8b2d-747cb81fed14" status: 200 len: 1362 microversion: 2.1 time: 0.225015 Jun 30 10:49:10.475024 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 438/872] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:49:10 2022] GET /compute/v2.1/servers/4ea0da70-2dc2-464e-8b2d-747cb81fed14 => generated 1362 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:49:11.491878 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-053ebfce-310b-4616-ac2a-d7709d2ac040 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:49:11.492696 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-053ebfce-310b-4616-ac2a-d7709d2ac040 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: 4ea0da70-2dc2-464e-8b2d-747cb81fed14] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:49:11.499344 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-053ebfce-310b-4616-ac2a-d7709d2ac040 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:11.499799 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-053ebfce-310b-4616-ac2a-d7709d2ac040 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:11.500579 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-053ebfce-310b-4616-ac2a-d7709d2ac040 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:11.501013 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-053ebfce-310b-4616-ac2a-d7709d2ac040 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:11.633907 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-053ebfce-310b-4616-ac2a-d7709d2ac040 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:11.641554 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-053ebfce-310b-4616-ac2a-d7709d2ac040 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/4ea0da70-2dc2-464e-8b2d-747cb81fed14" status: 200 len: 1362 microversion: 2.1 time: 0.154304 Jun 30 10:49:11.642114 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 435/873] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:49:11 2022] GET /compute/v2.1/servers/4ea0da70-2dc2-464e-8b2d-747cb81fed14 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:49:12.658457 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-5c3058e1-c672-4023-ac29-40fa6fca5f9b tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:49:12.659068 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-5c3058e1-c672-4023-ac29-40fa6fca5f9b tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: 4ea0da70-2dc2-464e-8b2d-747cb81fed14] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:49:12.665157 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-5c3058e1-c672-4023-ac29-40fa6fca5f9b tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:12.665609 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-5c3058e1-c672-4023-ac29-40fa6fca5f9b tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:12.666649 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-5c3058e1-c672-4023-ac29-40fa6fca5f9b tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:12.667091 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-5c3058e1-c672-4023-ac29-40fa6fca5f9b tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:12.793222 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-5c3058e1-c672-4023-ac29-40fa6fca5f9b tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:12.801069 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-5c3058e1-c672-4023-ac29-40fa6fca5f9b tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/4ea0da70-2dc2-464e-8b2d-747cb81fed14" status: 200 len: 1362 microversion: 2.1 time: 0.146487 Jun 30 10:49:12.801658 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 439/874] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:49:12 2022] GET /compute/v2.1/servers/4ea0da70-2dc2-464e-8b2d-747cb81fed14 => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:49:13.818244 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-abb349c4-31d7-4636-b3b5-c438d8146a7b tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:49:13.818777 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-abb349c4-31d7-4636-b3b5-c438d8146a7b tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: 4ea0da70-2dc2-464e-8b2d-747cb81fed14] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:49:13.825610 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-abb349c4-31d7-4636-b3b5-c438d8146a7b tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:13.826085 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-abb349c4-31d7-4636-b3b5-c438d8146a7b tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:13.826893 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-abb349c4-31d7-4636-b3b5-c438d8146a7b tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:13.827350 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-abb349c4-31d7-4636-b3b5-c438d8146a7b tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:13.966450 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-abb349c4-31d7-4636-b3b5-c438d8146a7b tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:13.975798 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-abb349c4-31d7-4636-b3b5-c438d8146a7b tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/4ea0da70-2dc2-464e-8b2d-747cb81fed14" status: 200 len: 1362 microversion: 2.1 time: 0.161584 Jun 30 10:49:13.976375 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 436/875] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:49:13 2022] GET /compute/v2.1/servers/4ea0da70-2dc2-464e-8b2d-747cb81fed14 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:49:14.993172 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-3add5c5e-a585-4b0f-9de9-5ed3f096c3fb tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:49:14.993778 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-3add5c5e-a585-4b0f-9de9-5ed3f096c3fb tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: 4ea0da70-2dc2-464e-8b2d-747cb81fed14] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:49:15.000795 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-3add5c5e-a585-4b0f-9de9-5ed3f096c3fb tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:15.001360 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-3add5c5e-a585-4b0f-9de9-5ed3f096c3fb tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:15.002116 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-3add5c5e-a585-4b0f-9de9-5ed3f096c3fb tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:15.002548 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-3add5c5e-a585-4b0f-9de9-5ed3f096c3fb tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:15.175651 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-3add5c5e-a585-4b0f-9de9-5ed3f096c3fb tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:15.183510 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-3add5c5e-a585-4b0f-9de9-5ed3f096c3fb tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/4ea0da70-2dc2-464e-8b2d-747cb81fed14" status: 200 len: 1362 microversion: 2.1 time: 0.194204 Jun 30 10:49:15.184067 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 440/876] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:49:14 2022] GET /compute/v2.1/servers/4ea0da70-2dc2-464e-8b2d-747cb81fed14 => generated 1362 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:49:16.200863 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-3bc4aeed-1184-4503-a61e-f799dc9a1b2d tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:49:16.201562 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-3bc4aeed-1184-4503-a61e-f799dc9a1b2d tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: 4ea0da70-2dc2-464e-8b2d-747cb81fed14] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:49:16.208477 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-3bc4aeed-1184-4503-a61e-f799dc9a1b2d tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:16.208955 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-3bc4aeed-1184-4503-a61e-f799dc9a1b2d tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:16.209727 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-3bc4aeed-1184-4503-a61e-f799dc9a1b2d tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:16.210160 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-3bc4aeed-1184-4503-a61e-f799dc9a1b2d tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:16.344821 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-3bc4aeed-1184-4503-a61e-f799dc9a1b2d tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:16.352665 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-3bc4aeed-1184-4503-a61e-f799dc9a1b2d tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/4ea0da70-2dc2-464e-8b2d-747cb81fed14" status: 200 len: 1362 microversion: 2.1 time: 0.155557 Jun 30 10:49:16.353231 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 437/877] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:49:16 2022] GET /compute/v2.1/servers/4ea0da70-2dc2-464e-8b2d-747cb81fed14 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:49:16.609228 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [req-69db94af-1e49-4b7d-8807-6b9a920d2769 req-b802a2af-e267-4a87-9496-1ef63d796db2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ea0da70-2dc2-464e-8b2d-747cb81fed14", "name": "network-vif-plugged", "status": "completed", "tag": "e406871b-4573-46e9-a343-7939230a9d1a"}]} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:49:16.622764 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-69db94af-1e49-4b7d-8807-6b9a920d2769 req-b802a2af-e267-4a87-9496-1ef63d796db2 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:16.623205 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-69db94af-1e49-4b7d-8807-6b9a920d2769 req-b802a2af-e267-4a87-9496-1ef63d796db2 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:16.638078 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.compute.server_external_events [req-69db94af-1e49-4b7d-8807-6b9a920d2769 req-b802a2af-e267-4a87-9496-1ef63d796db2 service nova] Creating event network-vif-plugged:e406871b-4573-46e9-a343-7939230a9d1a for instance 4ea0da70-2dc2-464e-8b2d-747cb81fed14 on hv-cinder-82282 Jun 30 10:49:16.643116 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [req-69db94af-1e49-4b7d-8807-6b9a920d2769 req-b802a2af-e267-4a87-9496-1ef63d796db2 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038196 Jun 30 10:49:16.644006 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 441/878] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:49:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:49:17.370791 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-6468aec3-e927-4f27-b1a3-40fb0bb8c928 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:49:17.371359 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-6468aec3-e927-4f27-b1a3-40fb0bb8c928 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: 4ea0da70-2dc2-464e-8b2d-747cb81fed14] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:49:17.377868 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6468aec3-e927-4f27-b1a3-40fb0bb8c928 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:17.378311 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6468aec3-e927-4f27-b1a3-40fb0bb8c928 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:17.379066 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6468aec3-e927-4f27-b1a3-40fb0bb8c928 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:17.379493 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6468aec3-e927-4f27-b1a3-40fb0bb8c928 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:17.515292 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-6468aec3-e927-4f27-b1a3-40fb0bb8c928 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:17.523530 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-6468aec3-e927-4f27-b1a3-40fb0bb8c928 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/4ea0da70-2dc2-464e-8b2d-747cb81fed14" status: 200 len: 1362 microversion: 2.1 time: 0.157023 Jun 30 10:49:17.524043 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 438/879] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:49:17 2022] GET /compute/v2.1/servers/4ea0da70-2dc2-464e-8b2d-747cb81fed14 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:49:18.537559 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_cell0:SELECT=6 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:49:18.541660 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-eeef99bd-2ee3-44fd-b8b3-ebbb56b41626 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:49:18.542356 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-eeef99bd-2ee3-44fd-b8b3-ebbb56b41626 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: 4ea0da70-2dc2-464e-8b2d-747cb81fed14] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:49:18.548888 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-eeef99bd-2ee3-44fd-b8b3-ebbb56b41626 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:18.549338 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-eeef99bd-2ee3-44fd-b8b3-ebbb56b41626 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:18.550138 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-eeef99bd-2ee3-44fd-b8b3-ebbb56b41626 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:18.550573 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-eeef99bd-2ee3-44fd-b8b3-ebbb56b41626 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:18.687777 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-eeef99bd-2ee3-44fd-b8b3-ebbb56b41626 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:18.696483 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-eeef99bd-2ee3-44fd-b8b3-ebbb56b41626 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/4ea0da70-2dc2-464e-8b2d-747cb81fed14" status: 200 len: 1362 microversion: 2.1 time: 0.160573 Jun 30 10:49:18.706627 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 442/880] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:49:18 2022] GET /compute/v2.1/servers/4ea0da70-2dc2-464e-8b2d-747cb81fed14 => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:49:19.713410 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-3574fdf7-2f2a-42b0-aa16-032b183bc78c tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:49:19.714012 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-3574fdf7-2f2a-42b0-aa16-032b183bc78c tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: 4ea0da70-2dc2-464e-8b2d-747cb81fed14] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:49:19.716006 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_cell0:SELECT=2 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:49:19.716669 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_cell0:SELECT=6 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:49:19.722903 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-3574fdf7-2f2a-42b0-aa16-032b183bc78c tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:19.723284 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-3574fdf7-2f2a-42b0-aa16-032b183bc78c tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:19.724029 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-3574fdf7-2f2a-42b0-aa16-032b183bc78c tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:19.724457 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-3574fdf7-2f2a-42b0-aa16-032b183bc78c tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:19.855731 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-3574fdf7-2f2a-42b0-aa16-032b183bc78c tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:19.863348 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-3574fdf7-2f2a-42b0-aa16-032b183bc78c tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/4ea0da70-2dc2-464e-8b2d-747cb81fed14" status: 200 len: 1548 microversion: 2.1 time: 0.153780 Jun 30 10:49:19.864397 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 439/881] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:49:19 2022] GET /compute/v2.1/servers/4ea0da70-2dc2-464e-8b2d-747cb81fed14 => generated 1548 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:49:19.880390 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-bd90f957-ddb1-4948-acf4-50f71ec7978a tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:49:19.880942 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-bd90f957-ddb1-4948-acf4-50f71ec7978a tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: 4ea0da70-2dc2-464e-8b2d-747cb81fed14] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:49:19.887401 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-bd90f957-ddb1-4948-acf4-50f71ec7978a tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:19.887883 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-bd90f957-ddb1-4948-acf4-50f71ec7978a tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:19.888706 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-bd90f957-ddb1-4948-acf4-50f71ec7978a tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:19.889144 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-bd90f957-ddb1-4948-acf4-50f71ec7978a tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:19.965925 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-bd90f957-ddb1-4948-acf4-50f71ec7978a tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/4ea0da70-2dc2-464e-8b2d-747cb81fed14/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089883 Jun 30 10:49:19.966419 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 443/882] 10.222.0.59 () {58 vars in 1274 bytes} [Thu Jun 30 10:49:19 2022] GET /compute/v2.1/servers/4ea0da70-2dc2-464e-8b2d-747cb81fed14/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:49:21.073699 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [req-25f9388f-53a8-4c27-9d45-1cdfe9e75aca req-02de5a02-c312-418f-bd6e-e288c348bed8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ea0da70-2dc2-464e-8b2d-747cb81fed14", "tag": "e406871b-4573-46e9-a343-7939230a9d1a"}]} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:49:21.082047 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-25f9388f-53a8-4c27-9d45-1cdfe9e75aca req-02de5a02-c312-418f-bd6e-e288c348bed8 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:21.082497 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-25f9388f-53a8-4c27-9d45-1cdfe9e75aca req-02de5a02-c312-418f-bd6e-e288c348bed8 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:21.093964 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.compute.server_external_events [req-25f9388f-53a8-4c27-9d45-1cdfe9e75aca req-02de5a02-c312-418f-bd6e-e288c348bed8 service nova] Creating event network-changed:e406871b-4573-46e9-a343-7939230a9d1a for instance 4ea0da70-2dc2-464e-8b2d-747cb81fed14 on hv-cinder-82282 Jun 30 10:49:21.099966 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [req-25f9388f-53a8-4c27-9d45-1cdfe9e75aca req-02de5a02-c312-418f-bd6e-e288c348bed8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029710 Jun 30 10:49:21.100587 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 440/883] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:49:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:49:28.967618 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-07678c46-7278-4ae4-8ad3-38bd5897b687 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:49:28.968151 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-07678c46-7278-4ae4-8ad3-38bd5897b687 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:49:28.974240 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-07678c46-7278-4ae4-8ad3-38bd5897b687 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:28.974687 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-07678c46-7278-4ae4-8ad3-38bd5897b687 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:28.975982 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-07678c46-7278-4ae4-8ad3-38bd5897b687 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:28.976423 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-07678c46-7278-4ae4-8ad3-38bd5897b687 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:28.999911 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-07678c46-7278-4ae4-8ad3-38bd5897b687 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224/ips" status: 200 len: 150 microversion: 2.20 time: 0.036782 Jun 30 10:49:29.000482 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 444/884] 10.222.0.59 () {60 vars in 1288 bytes} [Thu Jun 30 10:49:28 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 10:49:30.793451 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-2e27a06d-d45b-4b53-8373-9905e317b53e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:49:30.794074 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-2e27a06d-d45b-4b53-8373-9905e317b53e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:49:30.800833 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-2e27a06d-d45b-4b53-8373-9905e317b53e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:30.801279 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-2e27a06d-d45b-4b53-8373-9905e317b53e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:30.802034 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-2e27a06d-d45b-4b53-8373-9905e317b53e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:30.802463 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-2e27a06d-d45b-4b53-8373-9905e317b53e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:30.826941 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.objects.instance [None req-2e27a06d-d45b-4b53-8373-9905e317b53e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lazy-loading 'flavor' on Instance uuid 7a6b5e16-473d-4317-8bf7-ee0df07cb224 {{(pid=124204) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 10:49:31.090426 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-2e27a06d-d45b-4b53-8373-9905e317b53e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "POST /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224/action" status: 202 len: 0 microversion: 2.20 time: 0.300989 Jun 30 10:49:31.091050 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 441/885] 10.222.0.59 () {62 vars in 1318 bytes} [Thu Jun 30 10:49:30 2022] POST /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224/action => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 30 10:49:31.101275 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-0938e33d-be4b-4417-94c0-401be5d55218 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:49:31.102483 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-0938e33d-be4b-4417-94c0-401be5d55218 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:49:31.110384 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0938e33d-be4b-4417-94c0-401be5d55218 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:31.110936 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0938e33d-be4b-4417-94c0-401be5d55218 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:31.111813 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0938e33d-be4b-4417-94c0-401be5d55218 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:31.113460 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0938e33d-be4b-4417-94c0-401be5d55218 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:31.244843 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-0938e33d-be4b-4417-94c0-401be5d55218 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:31.253346 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-0938e33d-be4b-4417-94c0-401be5d55218 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:31.254892 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-0938e33d-be4b-4417-94c0-401be5d55218 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:31.256058 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-0938e33d-be4b-4417-94c0-401be5d55218 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224" status: 200 len: 1721 microversion: 2.20 time: 0.160666 Jun 30 10:49:31.257146 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 445/886] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:49:31 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:49:32.275450 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-95ced71f-51c9-4380-a61c-169231c73132 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:49:32.276139 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-95ced71f-51c9-4380-a61c-169231c73132 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:49:32.278080 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:49:32.283677 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-95ced71f-51c9-4380-a61c-169231c73132 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:32.284125 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-95ced71f-51c9-4380-a61c-169231c73132 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:32.284888 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-95ced71f-51c9-4380-a61c-169231c73132 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:32.285330 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-95ced71f-51c9-4380-a61c-169231c73132 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:32.290241 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:49:32.422355 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-95ced71f-51c9-4380-a61c-169231c73132 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:32.431215 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-95ced71f-51c9-4380-a61c-169231c73132 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:32.432807 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-95ced71f-51c9-4380-a61c-169231c73132 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:32.434002 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-95ced71f-51c9-4380-a61c-169231c73132 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224" status: 200 len: 1721 microversion: 2.20 time: 0.163881 Jun 30 10:49:32.434559 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 442/887] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:49:32 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:49:33.454241 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-60fec678-6cdf-4c5c-9652-95c8fbd1b3e4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:49:33.454714 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-60fec678-6cdf-4c5c-9652-95c8fbd1b3e4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:49:33.457021 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:49:33.462531 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-60fec678-6cdf-4c5c-9652-95c8fbd1b3e4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:33.462981 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-60fec678-6cdf-4c5c-9652-95c8fbd1b3e4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:33.463751 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-60fec678-6cdf-4c5c-9652-95c8fbd1b3e4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:33.464189 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-60fec678-6cdf-4c5c-9652-95c8fbd1b3e4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:33.469064 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_cell1:SELECT=57 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:49:33.599690 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-60fec678-6cdf-4c5c-9652-95c8fbd1b3e4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:33.608355 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-60fec678-6cdf-4c5c-9652-95c8fbd1b3e4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:33.609882 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-60fec678-6cdf-4c5c-9652-95c8fbd1b3e4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:33.611029 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-60fec678-6cdf-4c5c-9652-95c8fbd1b3e4 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224" status: 200 len: 1721 microversion: 2.20 time: 0.160990 Jun 30 10:49:33.618936 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 446/888] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:49:33 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:49:34.629467 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-b1a4acb9-2c6e-451c-9231-6a4ef4a0f4b2 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:49:34.630071 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-b1a4acb9-2c6e-451c-9231-6a4ef4a0f4b2 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:49:34.636446 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-b1a4acb9-2c6e-451c-9231-6a4ef4a0f4b2 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:34.636916 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-b1a4acb9-2c6e-451c-9231-6a4ef4a0f4b2 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:34.637665 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-b1a4acb9-2c6e-451c-9231-6a4ef4a0f4b2 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:34.638093 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-b1a4acb9-2c6e-451c-9231-6a4ef4a0f4b2 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:34.768494 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-b1a4acb9-2c6e-451c-9231-6a4ef4a0f4b2 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:34.778755 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-b1a4acb9-2c6e-451c-9231-6a4ef4a0f4b2 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:34.780360 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-b1a4acb9-2c6e-451c-9231-6a4ef4a0f4b2 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:34.781645 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-b1a4acb9-2c6e-451c-9231-6a4ef4a0f4b2 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224" status: 200 len: 1721 microversion: 2.20 time: 0.156046 Jun 30 10:49:34.782486 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 443/889] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:49:34 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:49:35.801269 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-0f6a6942-45c8-4f3a-88b0-4ce31f872e4b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:49:35.801878 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-0f6a6942-45c8-4f3a-88b0-4ce31f872e4b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:49:35.809475 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0f6a6942-45c8-4f3a-88b0-4ce31f872e4b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:35.810090 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0f6a6942-45c8-4f3a-88b0-4ce31f872e4b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:35.810870 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0f6a6942-45c8-4f3a-88b0-4ce31f872e4b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:35.811317 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0f6a6942-45c8-4f3a-88b0-4ce31f872e4b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:35.950435 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-0f6a6942-45c8-4f3a-88b0-4ce31f872e4b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:35.958402 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-0f6a6942-45c8-4f3a-88b0-4ce31f872e4b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:35.960253 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-0f6a6942-45c8-4f3a-88b0-4ce31f872e4b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:35.961934 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-0f6a6942-45c8-4f3a-88b0-4ce31f872e4b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224" status: 200 len: 1721 microversion: 2.20 time: 0.164521 Jun 30 10:49:35.962713 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 447/890] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:49:35 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:49:36.981919 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-1bf94965-4269-4ea6-b0eb-a3f119707875 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:49:36.982431 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-1bf94965-4269-4ea6-b0eb-a3f119707875 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:49:36.989306 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1bf94965-4269-4ea6-b0eb-a3f119707875 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:36.989977 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1bf94965-4269-4ea6-b0eb-a3f119707875 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:36.991018 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1bf94965-4269-4ea6-b0eb-a3f119707875 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:36.991526 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1bf94965-4269-4ea6-b0eb-a3f119707875 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:37.136880 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-1bf94965-4269-4ea6-b0eb-a3f119707875 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:37.145552 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-1bf94965-4269-4ea6-b0eb-a3f119707875 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:37.148026 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-1bf94965-4269-4ea6-b0eb-a3f119707875 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:37.149430 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-1bf94965-4269-4ea6-b0eb-a3f119707875 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224" status: 200 len: 1721 microversion: 2.20 time: 0.171575 Jun 30 10:49:37.150580 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 444/891] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:49:36 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:49:38.167596 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-e7c2cdb6-b6e5-4ca9-854d-3359b72c3f0b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:49:38.168193 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-e7c2cdb6-b6e5-4ca9-854d-3359b72c3f0b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:49:38.175260 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e7c2cdb6-b6e5-4ca9-854d-3359b72c3f0b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:38.175937 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e7c2cdb6-b6e5-4ca9-854d-3359b72c3f0b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:38.176931 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e7c2cdb6-b6e5-4ca9-854d-3359b72c3f0b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:38.177535 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e7c2cdb6-b6e5-4ca9-854d-3359b72c3f0b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:38.408176 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-e7c2cdb6-b6e5-4ca9-854d-3359b72c3f0b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:38.423516 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-e7c2cdb6-b6e5-4ca9-854d-3359b72c3f0b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:38.426045 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-e7c2cdb6-b6e5-4ca9-854d-3359b72c3f0b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:38.427703 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-e7c2cdb6-b6e5-4ca9-854d-3359b72c3f0b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224" status: 200 len: 1721 microversion: 2.20 time: 0.263998 Jun 30 10:49:38.441191 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 448/892] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:49:38 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 => generated 1721 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:49:39.447978 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-f57fd0f2-2af0-49c7-a5e3-66c7487e4b0e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:49:39.449250 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-f57fd0f2-2af0-49c7-a5e3-66c7487e4b0e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:49:39.458679 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f57fd0f2-2af0-49c7-a5e3-66c7487e4b0e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:39.459123 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f57fd0f2-2af0-49c7-a5e3-66c7487e4b0e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:39.460068 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f57fd0f2-2af0-49c7-a5e3-66c7487e4b0e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:39.462571 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f57fd0f2-2af0-49c7-a5e3-66c7487e4b0e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:39.686521 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-f57fd0f2-2af0-49c7-a5e3-66c7487e4b0e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:39.696809 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-f57fd0f2-2af0-49c7-a5e3-66c7487e4b0e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:39.698540 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-f57fd0f2-2af0-49c7-a5e3-66c7487e4b0e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:39.699718 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-f57fd0f2-2af0-49c7-a5e3-66c7487e4b0e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224" status: 200 len: 1721 microversion: 2.20 time: 0.256389 Jun 30 10:49:39.700431 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 445/893] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:49:39 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 => generated 1721 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:49:40.717728 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-a016e64d-1916-43b0-88af-c9342e8a4f2c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:49:40.719020 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-a016e64d-1916-43b0-88af-c9342e8a4f2c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:49:40.728153 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a016e64d-1916-43b0-88af-c9342e8a4f2c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:40.728761 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a016e64d-1916-43b0-88af-c9342e8a4f2c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:40.729534 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a016e64d-1916-43b0-88af-c9342e8a4f2c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:40.729962 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a016e64d-1916-43b0-88af-c9342e8a4f2c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:40.958638 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-a016e64d-1916-43b0-88af-c9342e8a4f2c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:40.966924 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-a016e64d-1916-43b0-88af-c9342e8a4f2c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:40.968416 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-a016e64d-1916-43b0-88af-c9342e8a4f2c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:40.969605 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-a016e64d-1916-43b0-88af-c9342e8a4f2c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224" status: 200 len: 1721 microversion: 2.20 time: 0.255955 Jun 30 10:49:40.970162 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 449/894] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:49:40 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 => generated 1721 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:49:41.989129 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-ca7f62e6-b119-49ed-ab94-a84dd7f98922 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:49:41.990392 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-ca7f62e6-b119-49ed-ab94-a84dd7f98922 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:49:42.003401 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ca7f62e6-b119-49ed-ab94-a84dd7f98922 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:42.004862 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ca7f62e6-b119-49ed-ab94-a84dd7f98922 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:42.005666 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ca7f62e6-b119-49ed-ab94-a84dd7f98922 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:42.006099 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ca7f62e6-b119-49ed-ab94-a84dd7f98922 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:42.343419 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-ca7f62e6-b119-49ed-ab94-a84dd7f98922 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:42.352434 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-ca7f62e6-b119-49ed-ab94-a84dd7f98922 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:42.354097 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-ca7f62e6-b119-49ed-ab94-a84dd7f98922 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:42.355368 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-ca7f62e6-b119-49ed-ab94-a84dd7f98922 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224" status: 200 len: 1721 microversion: 2.20 time: 0.370252 Jun 30 10:49:42.356493 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 446/895] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:49:41 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 => generated 1721 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:49:43.374727 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-c9c3cb9a-fc33-44cc-9234-db951a6dbbfd tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:49:43.376031 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-c9c3cb9a-fc33-44cc-9234-db951a6dbbfd tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:49:43.383398 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c9c3cb9a-fc33-44cc-9234-db951a6dbbfd tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:43.384089 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c9c3cb9a-fc33-44cc-9234-db951a6dbbfd tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:43.385211 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c9c3cb9a-fc33-44cc-9234-db951a6dbbfd tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:43.385857 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c9c3cb9a-fc33-44cc-9234-db951a6dbbfd tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:43.580488 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-c9c3cb9a-fc33-44cc-9234-db951a6dbbfd tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:43.590371 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-c9c3cb9a-fc33-44cc-9234-db951a6dbbfd tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:43.592934 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-c9c3cb9a-fc33-44cc-9234-db951a6dbbfd tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:43.594549 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-c9c3cb9a-fc33-44cc-9234-db951a6dbbfd tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224" status: 200 len: 1742 microversion: 2.20 time: 0.223485 Jun 30 10:49:43.596059 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 450/896] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:49:43 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 => generated 1742 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:49:44.614647 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-43788588-691d-4595-92f7-0412790a934c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:49:44.615281 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-43788588-691d-4595-92f7-0412790a934c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:49:44.623291 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-43788588-691d-4595-92f7-0412790a934c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:44.623698 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-43788588-691d-4595-92f7-0412790a934c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:44.624690 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-43788588-691d-4595-92f7-0412790a934c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:44.625288 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-43788588-691d-4595-92f7-0412790a934c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:44.790337 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-43788588-691d-4595-92f7-0412790a934c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:44.799558 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-43788588-691d-4595-92f7-0412790a934c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:44.801090 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-43788588-691d-4595-92f7-0412790a934c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:44.802800 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-43788588-691d-4595-92f7-0412790a934c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224" status: 200 len: 1742 microversion: 2.20 time: 0.192371 Jun 30 10:49:44.803393 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 447/897] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:49:44 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 => generated 1742 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:49:45.820912 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-b1f2a319-c8c4-40a6-abc9-692cf40b8210 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:49:45.821528 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-b1f2a319-c8c4-40a6-abc9-692cf40b8210 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:49:45.827873 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b1f2a319-c8c4-40a6-abc9-692cf40b8210 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:45.828324 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b1f2a319-c8c4-40a6-abc9-692cf40b8210 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:45.829132 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b1f2a319-c8c4-40a6-abc9-692cf40b8210 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:45.829574 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b1f2a319-c8c4-40a6-abc9-692cf40b8210 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:46.028733 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-b1f2a319-c8c4-40a6-abc9-692cf40b8210 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:46.041020 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-b1f2a319-c8c4-40a6-abc9-692cf40b8210 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:46.043287 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-b1f2a319-c8c4-40a6-abc9-692cf40b8210 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:46.044747 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-b1f2a319-c8c4-40a6-abc9-692cf40b8210 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224" status: 200 len: 1742 microversion: 2.20 time: 0.227667 Jun 30 10:49:46.045499 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 451/898] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:49:45 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 => generated 1742 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:49:46.823372 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [req-16724b3e-fba9-42cc-86e2-061184a5a1f0 req-8e447594-bec1-4ab4-b9da-043b51c46466 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a6b5e16-473d-4317-8bf7-ee0df07cb224", "name": "network-vif-plugged", "status": "completed", "tag": "616d9e47-3706-4db1-a51a-9e45603ab16c"}]} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:49:46.837310 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-16724b3e-fba9-42cc-86e2-061184a5a1f0 req-8e447594-bec1-4ab4-b9da-043b51c46466 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:46.838009 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-16724b3e-fba9-42cc-86e2-061184a5a1f0 req-8e447594-bec1-4ab4-b9da-043b51c46466 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:46.859623 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.compute.server_external_events [req-16724b3e-fba9-42cc-86e2-061184a5a1f0 req-8e447594-bec1-4ab4-b9da-043b51c46466 service nova] Creating event network-vif-plugged:616d9e47-3706-4db1-a51a-9e45603ab16c for instance 7a6b5e16-473d-4317-8bf7-ee0df07cb224 on hv-cinder-82282 Jun 30 10:49:46.865288 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [req-16724b3e-fba9-42cc-86e2-061184a5a1f0 req-8e447594-bec1-4ab4-b9da-043b51c46466 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045473 Jun 30 10:49:46.866426 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 448/899] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:49:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:49:47.066400 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-8453136c-2814-4529-9a77-65b9cb1c647d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:49:47.067021 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-8453136c-2814-4529-9a77-65b9cb1c647d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:49:47.073882 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-8453136c-2814-4529-9a77-65b9cb1c647d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:47.074338 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-8453136c-2814-4529-9a77-65b9cb1c647d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:47.075105 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-8453136c-2814-4529-9a77-65b9cb1c647d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:47.075539 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-8453136c-2814-4529-9a77-65b9cb1c647d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:47.248547 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-8453136c-2814-4529-9a77-65b9cb1c647d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:47.261339 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-8453136c-2814-4529-9a77-65b9cb1c647d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:47.263705 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-8453136c-2814-4529-9a77-65b9cb1c647d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:47.265125 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-8453136c-2814-4529-9a77-65b9cb1c647d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224" status: 200 len: 1742 microversion: 2.20 time: 0.205862 Jun 30 10:49:47.275008 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 452/900] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:49:47 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 => generated 1742 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:49:48.288904 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-52101eee-a93c-43f4-b6b4-c6c48b805481 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:49:48.290387 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-52101eee-a93c-43f4-b6b4-c6c48b805481 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:49:48.297488 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-52101eee-a93c-43f4-b6b4-c6c48b805481 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:48.298120 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-52101eee-a93c-43f4-b6b4-c6c48b805481 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:48.299017 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-52101eee-a93c-43f4-b6b4-c6c48b805481 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:48.299553 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-52101eee-a93c-43f4-b6b4-c6c48b805481 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:48.457916 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-52101eee-a93c-43f4-b6b4-c6c48b805481 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:48.468197 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-52101eee-a93c-43f4-b6b4-c6c48b805481 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:48.471085 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-52101eee-a93c-43f4-b6b4-c6c48b805481 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:48.472563 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-52101eee-a93c-43f4-b6b4-c6c48b805481 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224" status: 200 len: 1742 microversion: 2.20 time: 0.188967 Jun 30 10:49:48.476850 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 449/901] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:49:48 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 => generated 1742 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:49:49.494292 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-ba4785e6-9621-4e90-bb2e-2a72891b1f8a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:49:49.499622 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-ba4785e6-9621-4e90-bb2e-2a72891b1f8a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:49:49.515226 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ba4785e6-9621-4e90-bb2e-2a72891b1f8a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:49.518842 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ba4785e6-9621-4e90-bb2e-2a72891b1f8a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:49.520636 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ba4785e6-9621-4e90-bb2e-2a72891b1f8a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:49.523787 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ba4785e6-9621-4e90-bb2e-2a72891b1f8a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:49.765292 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-ba4785e6-9621-4e90-bb2e-2a72891b1f8a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:49.778138 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-ba4785e6-9621-4e90-bb2e-2a72891b1f8a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:49.782531 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-ba4785e6-9621-4e90-bb2e-2a72891b1f8a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:49.786628 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-ba4785e6-9621-4e90-bb2e-2a72891b1f8a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224" status: 200 len: 1742 microversion: 2.20 time: 0.296695 Jun 30 10:49:49.788623 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 453/902] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:49:49 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 => generated 1742 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:49:50.807481 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-3b35feb3-c9a6-420c-869b-5f779e829e48 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:49:50.808738 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-3b35feb3-c9a6-420c-869b-5f779e829e48 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:49:50.815251 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-3b35feb3-c9a6-420c-869b-5f779e829e48 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:50.816309 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-3b35feb3-c9a6-420c-869b-5f779e829e48 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:50.817293 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-3b35feb3-c9a6-420c-869b-5f779e829e48 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:50.817882 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-3b35feb3-c9a6-420c-869b-5f779e829e48 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:50.990025 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-3b35feb3-c9a6-420c-869b-5f779e829e48 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:51.001113 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-3b35feb3-c9a6-420c-869b-5f779e829e48 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:51.003027 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-3b35feb3-c9a6-420c-869b-5f779e829e48 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:51.004470 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-3b35feb3-c9a6-420c-869b-5f779e829e48 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224" status: 200 len: 1737 microversion: 2.20 time: 0.201519 Jun 30 10:49:51.005682 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 450/903] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:49:50 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 => generated 1737 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:49:52.029361 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-2b5f0452-86e6-44a0-ad27-0cb4018a8d4f tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:49:52.030053 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-2b5f0452-86e6-44a0-ad27-0cb4018a8d4f tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:49:52.037499 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-2ba92a8e-c4a8-406b-9a36-58e5dd1721b5 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:49:52.038040 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-2ba92a8e-c4a8-406b-9a36-58e5dd1721b5 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 5729f9ae-3c4d-490a-9501-b4806724de9d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:49:52.054413 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-2ba92a8e-c4a8-406b-9a36-58e5dd1721b5 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:52.055982 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-2b5f0452-86e6-44a0-ad27-0cb4018a8d4f tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:52.056714 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-2ba92a8e-c4a8-406b-9a36-58e5dd1721b5 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:52.057834 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-2ba92a8e-c4a8-406b-9a36-58e5dd1721b5 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:52.059087 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-2ba92a8e-c4a8-406b-9a36-58e5dd1721b5 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:52.061093 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-2b5f0452-86e6-44a0-ad27-0cb4018a8d4f tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:52.068166 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-2b5f0452-86e6-44a0-ad27-0cb4018a8d4f tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:52.069637 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-2b5f0452-86e6-44a0-ad27-0cb4018a8d4f tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:52.119328 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-2ba92a8e-c4a8-406b-9a36-58e5dd1721b5 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/5729f9ae-3c4d-490a-9501-b4806724de9d/ips" status: 200 len: 150 microversion: 2.1 time: 0.085591 Jun 30 10:49:52.119917 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 451/904] 10.222.0.59 () {58 vars in 1247 bytes} [Thu Jun 30 10:49:52 2022] GET /compute/v2.1/servers/5729f9ae-3c4d-490a-9501-b4806724de9d/ips => generated 150 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:49:52.454743 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-2b5f0452-86e6-44a0-ad27-0cb4018a8d4f tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:52.464190 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-2b5f0452-86e6-44a0-ad27-0cb4018a8d4f tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:52.472735 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-2b5f0452-86e6-44a0-ad27-0cb4018a8d4f tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:52.473982 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-2b5f0452-86e6-44a0-ad27-0cb4018a8d4f tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224" status: 200 len: 1737 microversion: 2.20 time: 0.448544 Jun 30 10:49:52.474573 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 454/905] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:49:52 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 => generated 1737 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:49:53.498429 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-6f3598bd-2074-4055-b40e-d390a1d12d59 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:49:53.499102 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-6f3598bd-2074-4055-b40e-d390a1d12d59 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:49:53.514114 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6f3598bd-2074-4055-b40e-d390a1d12d59 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:53.515954 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6f3598bd-2074-4055-b40e-d390a1d12d59 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:53.518578 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6f3598bd-2074-4055-b40e-d390a1d12d59 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:53.519291 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6f3598bd-2074-4055-b40e-d390a1d12d59 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:53.709935 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-6f3598bd-2074-4055-b40e-d390a1d12d59 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:53.718890 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-6f3598bd-2074-4055-b40e-d390a1d12d59 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:53.721961 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-6f3598bd-2074-4055-b40e-d390a1d12d59 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:53.723335 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-6f3598bd-2074-4055-b40e-d390a1d12d59 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224" status: 200 len: 1737 microversion: 2.20 time: 0.232526 Jun 30 10:49:53.727549 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 452/906] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:49:53 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 => generated 1737 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:49:54.021486 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-e122493e-61d1-4314-95fc-f2b46b9778b3 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4989d6a1-355d-4a47-8639-7040b0785c98"}} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:49:54.023731 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-e122493e-61d1-4314-95fc-f2b46b9778b3 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 5729f9ae-3c4d-490a-9501-b4806724de9d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:49:54.030618 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e122493e-61d1-4314-95fc-f2b46b9778b3 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:54.031293 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e122493e-61d1-4314-95fc-f2b46b9778b3 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:54.035986 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e122493e-61d1-4314-95fc-f2b46b9778b3 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:54.036742 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e122493e-61d1-4314-95fc-f2b46b9778b3 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:54.378060 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-e122493e-61d1-4314-95fc-f2b46b9778b3 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "POST /compute/v2.1/servers/5729f9ae-3c4d-490a-9501-b4806724de9d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.360241 Jun 30 10:49:54.379086 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 455/907] 10.222.0.59 () {60 vars in 1322 bytes} [Thu Jun 30 10:49:54 2022] POST /compute/v2.1/servers/5729f9ae-3c4d-490a-9501-b4806724de9d/os-volume_attachments => generated 194 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:49:54.745696 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-5cc3a351-6ee7-4e82-80ff-dc063c6072df tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:49:54.745696 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-5cc3a351-6ee7-4e82-80ff-dc063c6072df tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:49:54.752950 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5cc3a351-6ee7-4e82-80ff-dc063c6072df tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:54.753403 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5cc3a351-6ee7-4e82-80ff-dc063c6072df tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:54.754172 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5cc3a351-6ee7-4e82-80ff-dc063c6072df tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:54.754612 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5cc3a351-6ee7-4e82-80ff-dc063c6072df tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:55.047561 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-5cc3a351-6ee7-4e82-80ff-dc063c6072df tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:55.089115 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-5cc3a351-6ee7-4e82-80ff-dc063c6072df tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:55.091060 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-5cc3a351-6ee7-4e82-80ff-dc063c6072df tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:55.092284 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-5cc3a351-6ee7-4e82-80ff-dc063c6072df tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224" status: 200 len: 1737 microversion: 2.20 time: 0.351120 Jun 30 10:49:55.093466 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 453/908] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:49:54 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 => generated 1737 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:49:55.924533 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-416d9e51-def1-48ef-b723-fa5c250eb7f1 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Action: 'create', calling method: .version_select at 0x7f4db25250d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-449752249", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIBU72Kps3x1AjDJWtFkvjegBlqte8Z79BqtN1r+4SyPHa9wRBQ5ekDoYuZLZC2Qf/sMi7s4w7MZtsYMRHu4dLpemos7XDYz0LHkYtucGcwWgruWLmMWdwoI7xX42vniTA=="}} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:49:55.943354 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.quota [None req-416d9e51-def1-48ef-b723-fa5c250eb7f1 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Getting quotas for project 9d4ab649bf434f78b83122111ec19083. Resources: {'key_pairs'} {{(pid=124203) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 10:49:55.949628 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.quota [None req-416d9e51-def1-48ef-b723-fa5c250eb7f1 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Getting quotas for user 9a24491b2e4545e289fa4f1cff4f30d1 and project 9d4ab649bf434f78b83122111ec19083. Resources: {'key_pairs'} {{(pid=124203) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 10:49:55.976901 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-416d9e51-def1-48ef-b723-fa5c250eb7f1 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.057305 Jun 30 10:49:55.977926 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 456/909] 10.222.0.59 () {60 vars in 1158 bytes} [Thu Jun 30 10:49:55 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:49:56.029100 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-aa81ca5d-d7d8-4df2-8d44-1189658065cc tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2025398559", "imageRef": "9816cde3-c84f-447e-85b2-37ee61c27cee", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-449752249", "networks": [{"uuid": "501e5e64-1a86-4a9d-b912-f722af21a272"}]}} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:49:56.088951 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.network.neutron [None req-aa81ca5d-d7d8-4df2-8d44-1189658065cc tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] validate_networks() for [('501e5e64-1a86-4a9d-b912-f722af21a272', None, None, None, None, None)] {{(pid=124204) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 10:49:56.111291 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-84d4a771-6d6b-427a-91a7-37840fe2436a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:49:56.112036 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-84d4a771-6d6b-427a-91a7-37840fe2436a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:49:56.119539 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-84d4a771-6d6b-427a-91a7-37840fe2436a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:56.119990 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-84d4a771-6d6b-427a-91a7-37840fe2436a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:56.121110 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-84d4a771-6d6b-427a-91a7-37840fe2436a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:56.121555 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-84d4a771-6d6b-427a-91a7-37840fe2436a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:56.373908 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-84d4a771-6d6b-427a-91a7-37840fe2436a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:56.386823 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-84d4a771-6d6b-427a-91a7-37840fe2436a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:56.388636 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-84d4a771-6d6b-427a-91a7-37840fe2436a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:56.390084 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-84d4a771-6d6b-427a-91a7-37840fe2436a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224" status: 200 len: 1737 microversion: 2.20 time: 0.283469 Jun 30 10:49:56.391159 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 457/910] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:49:56 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 => generated 1737 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:49:56.591665 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.virt.hardware [None req-aa81ca5d-d7d8-4df2-8d44-1189658065cc tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Flavor limits 0:0:0 {{(pid=124204) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 10:49:56.592547 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.virt.hardware [None req-aa81ca5d-d7d8-4df2-8d44-1189658065cc tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Image limits 0:0:0 {{(pid=124204) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 10:49:56.593181 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.virt.hardware [None req-aa81ca5d-d7d8-4df2-8d44-1189658065cc tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Flavor pref 0:0:0 {{(pid=124204) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 10:49:56.593754 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.virt.hardware [None req-aa81ca5d-d7d8-4df2-8d44-1189658065cc tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Image pref 0:0:0 {{(pid=124204) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 10:49:56.594250 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.virt.hardware [None req-aa81ca5d-d7d8-4df2-8d44-1189658065cc tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124204) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 10:49:56.609512 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-aa81ca5d-d7d8-4df2-8d44-1189658065cc tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:56.610068 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-aa81ca5d-d7d8-4df2-8d44-1189658065cc tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:56.611144 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-aa81ca5d-d7d8-4df2-8d44-1189658065cc tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:56.611833 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-aa81ca5d-d7d8-4df2-8d44-1189658065cc tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:56.630260 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.quota [None req-aa81ca5d-d7d8-4df2-8d44-1189658065cc tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Getting quotas for project 9d4ab649bf434f78b83122111ec19083. Resources: {'instances', 'cores', 'ram'} {{(pid=124204) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 10:49:56.634784 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.quota [None req-aa81ca5d-d7d8-4df2-8d44-1189658065cc tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Getting quotas for user 9a24491b2e4545e289fa4f1cff4f30d1 and project 9d4ab649bf434f78b83122111ec19083. Resources: {'instances', 'cores', 'ram'} {{(pid=124204) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 10:49:56.648696 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-aa81ca5d-d7d8-4df2-8d44-1189658065cc tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Going to run 1 instances... {{(pid=124204) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 10:49:56.651358 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-aa81ca5d-d7d8-4df2-8d44-1189658065cc tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] [instance: 6526331b-07d9-4ae7-8429-187bf752923d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9816cde3-c84f-447e-85b2-37ee61c27cee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124204) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 10:49:56.701632 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-aa81ca5d-d7d8-4df2-8d44-1189658065cc tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.677026 Jun 30 10:49:56.702549 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 454/911] 10.222.0.59 () {60 vars in 1146 bytes} [Thu Jun 30 10:49:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 679 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 30 10:49:56.712890 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-bc312aa0-c10c-49bd-b108-9c8cdfa1c8dd tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:49:56.713503 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-bc312aa0-c10c-49bd-b108-9c8cdfa1c8dd tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] [instance: 6526331b-07d9-4ae7-8429-187bf752923d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:49:56.782432 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-bc312aa0-c10c-49bd-b108-9c8cdfa1c8dd tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a24491b2e4545e289fa4f1cff4f30d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ab649bf434f78b83122111ec19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:56.789159 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-bc312aa0-c10c-49bd-b108-9c8cdfa1c8dd tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] 10.222.0.59 "GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d" status: 200 len: 1258 microversion: 2.1 time: 0.080862 Jun 30 10:49:56.789729 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 458/912] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:49:56 2022] GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d => generated 1258 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:49:57.409389 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-cec1abc8-0a73-4285-b430-99e0e0df87c7 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:49:57.409996 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-cec1abc8-0a73-4285-b430-99e0e0df87c7 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:49:57.420553 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-cec1abc8-0a73-4285-b430-99e0e0df87c7 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:57.421014 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-cec1abc8-0a73-4285-b430-99e0e0df87c7 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:57.421789 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-cec1abc8-0a73-4285-b430-99e0e0df87c7 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:57.422231 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-cec1abc8-0a73-4285-b430-99e0e0df87c7 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:57.562018 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-cec1abc8-0a73-4285-b430-99e0e0df87c7 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:57.570729 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-cec1abc8-0a73-4285-b430-99e0e0df87c7 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:57.572440 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-cec1abc8-0a73-4285-b430-99e0e0df87c7 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:57.573857 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-cec1abc8-0a73-4285-b430-99e0e0df87c7 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224" status: 200 len: 1737 microversion: 2.20 time: 0.169137 Jun 30 10:49:57.574544 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 455/913] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:49:57 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 => generated 1737 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:49:57.805916 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-57e3b922-f15d-46af-8fbd-a58bc672de2e tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:49:57.807183 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-57e3b922-f15d-46af-8fbd-a58bc672de2e tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] [instance: 6526331b-07d9-4ae7-8429-187bf752923d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:49:57.819108 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-57e3b922-f15d-46af-8fbd-a58bc672de2e tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:57.821302 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-57e3b922-f15d-46af-8fbd-a58bc672de2e tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:57.822182 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-57e3b922-f15d-46af-8fbd-a58bc672de2e tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:57.825742 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-57e3b922-f15d-46af-8fbd-a58bc672de2e tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:57.906428 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-57e3b922-f15d-46af-8fbd-a58bc672de2e tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a24491b2e4545e289fa4f1cff4f30d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ab649bf434f78b83122111ec19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:57.918852 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-57e3b922-f15d-46af-8fbd-a58bc672de2e tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] 10.222.0.59 "GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d" status: 200 len: 1328 microversion: 2.1 time: 0.115987 Jun 30 10:49:57.920047 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 459/914] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:49:57 2022] GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d => generated 1328 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:49:58.593612 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-8a750d93-5f28-47d6-bf4e-6595224a5a9e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:49:58.594301 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-8a750d93-5f28-47d6-bf4e-6595224a5a9e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:49:58.604283 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-8a750d93-5f28-47d6-bf4e-6595224a5a9e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:58.607243 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-8a750d93-5f28-47d6-bf4e-6595224a5a9e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:58.608453 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-8a750d93-5f28-47d6-bf4e-6595224a5a9e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:58.611465 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-8a750d93-5f28-47d6-bf4e-6595224a5a9e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:58.861450 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-8a750d93-5f28-47d6-bf4e-6595224a5a9e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:58.873545 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-8a750d93-5f28-47d6-bf4e-6595224a5a9e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:58.877608 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-8a750d93-5f28-47d6-bf4e-6595224a5a9e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:58.889961 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-8a750d93-5f28-47d6-bf4e-6595224a5a9e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224" status: 200 len: 1737 microversion: 2.20 time: 0.300359 Jun 30 10:49:58.899915 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 456/915] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:49:58 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 => generated 1737 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 10:49:58.941940 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-0090b259-2be5-4cbf-bb0e-87e088eb2453 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:49:58.942712 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-0090b259-2be5-4cbf-bb0e-87e088eb2453 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] [instance: 6526331b-07d9-4ae7-8429-187bf752923d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:49:58.955527 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0090b259-2be5-4cbf-bb0e-87e088eb2453 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:58.957847 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0090b259-2be5-4cbf-bb0e-87e088eb2453 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:58.959615 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0090b259-2be5-4cbf-bb0e-87e088eb2453 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:58.961227 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0090b259-2be5-4cbf-bb0e-87e088eb2453 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:59.430505 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-0090b259-2be5-4cbf-bb0e-87e088eb2453 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a24491b2e4545e289fa4f1cff4f30d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ab649bf434f78b83122111ec19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:49:59.439073 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-0090b259-2be5-4cbf-bb0e-87e088eb2453 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] 10.222.0.59 "GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d" status: 200 len: 1358 microversion: 2.1 time: 0.506132 Jun 30 10:49:59.442820 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 460/916] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:49:58 2022] GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d => generated 1358 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:49:59.926002 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-7af93438-59a0-432a-9d2f-d9ba528074c0 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:49:59.927462 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-7af93438-59a0-432a-9d2f-d9ba528074c0 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:49:59.937614 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-7af93438-59a0-432a-9d2f-d9ba528074c0 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:59.938068 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-7af93438-59a0-432a-9d2f-d9ba528074c0 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:49:59.949952 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-7af93438-59a0-432a-9d2f-d9ba528074c0 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:49:59.950475 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-7af93438-59a0-432a-9d2f-d9ba528074c0 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:00.156483 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-7af93438-59a0-432a-9d2f-d9ba528074c0 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:00.167407 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-7af93438-59a0-432a-9d2f-d9ba528074c0 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:00.169660 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-7af93438-59a0-432a-9d2f-d9ba528074c0 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:00.171284 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-7af93438-59a0-432a-9d2f-d9ba528074c0 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224" status: 200 len: 1737 microversion: 2.20 time: 0.249427 Jun 30 10:50:00.172155 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 457/917] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:49:59 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 => generated 1737 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:50:00.458066 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-20dc615c-af28-47e5-923d-d356d21cd9e1 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:00.458673 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-20dc615c-af28-47e5-923d-d356d21cd9e1 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] [instance: 6526331b-07d9-4ae7-8429-187bf752923d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:00.466286 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-20dc615c-af28-47e5-923d-d356d21cd9e1 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:00.466955 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-20dc615c-af28-47e5-923d-d356d21cd9e1 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:00.467881 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-20dc615c-af28-47e5-923d-d356d21cd9e1 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:00.468574 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-20dc615c-af28-47e5-923d-d356d21cd9e1 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:00.626462 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-20dc615c-af28-47e5-923d-d356d21cd9e1 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a24491b2e4545e289fa4f1cff4f30d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ab649bf434f78b83122111ec19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:00.636016 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-20dc615c-af28-47e5-923d-d356d21cd9e1 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] 10.222.0.59 "GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d" status: 200 len: 1358 microversion: 2.1 time: 0.181573 Jun 30 10:50:00.645355 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 461/918] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:50:00 2022] GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:50:01.194767 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-73ef8603-6c21-4914-8433-b2d014bff334 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:01.195935 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-73ef8603-6c21-4914-8433-b2d014bff334 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:01.203187 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-73ef8603-6c21-4914-8433-b2d014bff334 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:01.203633 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-73ef8603-6c21-4914-8433-b2d014bff334 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:01.204403 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-73ef8603-6c21-4914-8433-b2d014bff334 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:01.204862 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-73ef8603-6c21-4914-8433-b2d014bff334 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:01.352638 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-73ef8603-6c21-4914-8433-b2d014bff334 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:01.361141 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-73ef8603-6c21-4914-8433-b2d014bff334 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:01.362628 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-73ef8603-6c21-4914-8433-b2d014bff334 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:01.363793 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-73ef8603-6c21-4914-8433-b2d014bff334 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224" status: 200 len: 1737 microversion: 2.20 time: 0.176495 Jun 30 10:50:01.364358 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 458/919] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:50:01 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 => generated 1737 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:50:01.653565 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-2a44d52b-3f4e-495d-b91d-0171e4d2493e tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:01.654295 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-2a44d52b-3f4e-495d-b91d-0171e4d2493e tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] [instance: 6526331b-07d9-4ae7-8429-187bf752923d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:01.661371 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-2a44d52b-3f4e-495d-b91d-0171e4d2493e tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:01.662059 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-2a44d52b-3f4e-495d-b91d-0171e4d2493e tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:01.663487 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-2a44d52b-3f4e-495d-b91d-0171e4d2493e tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:01.663927 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-2a44d52b-3f4e-495d-b91d-0171e4d2493e tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:01.801106 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-2a44d52b-3f4e-495d-b91d-0171e4d2493e tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a24491b2e4545e289fa4f1cff4f30d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ab649bf434f78b83122111ec19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:01.809150 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-2a44d52b-3f4e-495d-b91d-0171e4d2493e tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] 10.222.0.59 "GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d" status: 200 len: 1358 microversion: 2.1 time: 0.159381 Jun 30 10:50:01.809734 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 462/920] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:50:01 2022] GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:50:02.387876 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-2e73e1d0-e499-472c-b667-0322274d9fe1 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:02.388461 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-2e73e1d0-e499-472c-b667-0322274d9fe1 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:02.390878 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:50:02.396359 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-2e73e1d0-e499-472c-b667-0322274d9fe1 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:02.396922 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-2e73e1d0-e499-472c-b667-0322274d9fe1 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:02.397801 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-2e73e1d0-e499-472c-b667-0322274d9fe1 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:02.398239 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-2e73e1d0-e499-472c-b667-0322274d9fe1 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:02.402358 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_cell1:SELECT=92 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:50:02.594057 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-2e73e1d0-e499-472c-b667-0322274d9fe1 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:02.603006 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-2e73e1d0-e499-472c-b667-0322274d9fe1 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:02.604636 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-2e73e1d0-e499-472c-b667-0322274d9fe1 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:02.605879 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-2e73e1d0-e499-472c-b667-0322274d9fe1 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224" status: 200 len: 1737 microversion: 2.20 time: 0.221901 Jun 30 10:50:02.607457 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 459/921] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:50:02 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 => generated 1737 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:50:02.826137 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-68c81e2a-d4b6-498b-9110-d1ad2aacdbf1 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:02.827508 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-68c81e2a-d4b6-498b-9110-d1ad2aacdbf1 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] [instance: 6526331b-07d9-4ae7-8429-187bf752923d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:02.835144 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-68c81e2a-d4b6-498b-9110-d1ad2aacdbf1 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:02.835599 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-68c81e2a-d4b6-498b-9110-d1ad2aacdbf1 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:02.836398 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-68c81e2a-d4b6-498b-9110-d1ad2aacdbf1 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:02.836899 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-68c81e2a-d4b6-498b-9110-d1ad2aacdbf1 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:02.852931 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:50:02.974235 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-68c81e2a-d4b6-498b-9110-d1ad2aacdbf1 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a24491b2e4545e289fa4f1cff4f30d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ab649bf434f78b83122111ec19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:02.993324 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-68c81e2a-d4b6-498b-9110-d1ad2aacdbf1 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] 10.222.0.59 "GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d" status: 200 len: 1358 microversion: 2.1 time: 0.171001 Jun 30 10:50:03.004937 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 463/922] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:50:02 2022] GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:50:03.625922 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-192c29de-1f71-4086-bf11-01e479952b47 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:03.626618 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-192c29de-1f71-4086-bf11-01e479952b47 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:03.633975 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-192c29de-1f71-4086-bf11-01e479952b47 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:03.634497 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-192c29de-1f71-4086-bf11-01e479952b47 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:03.635331 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-192c29de-1f71-4086-bf11-01e479952b47 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:03.635847 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-192c29de-1f71-4086-bf11-01e479952b47 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:03.771681 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-192c29de-1f71-4086-bf11-01e479952b47 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:03.780841 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-192c29de-1f71-4086-bf11-01e479952b47 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:03.782443 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-192c29de-1f71-4086-bf11-01e479952b47 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:03.783691 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-192c29de-1f71-4086-bf11-01e479952b47 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224" status: 200 len: 1737 microversion: 2.20 time: 0.161688 Jun 30 10:50:03.784261 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 460/923] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:50:03 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:50:04.021628 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-96eac1cb-766b-4e62-bf42-7b8492c46dc2 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:04.022401 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-96eac1cb-766b-4e62-bf42-7b8492c46dc2 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] [instance: 6526331b-07d9-4ae7-8429-187bf752923d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:04.024844 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:50:04.030475 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-96eac1cb-766b-4e62-bf42-7b8492c46dc2 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:04.030475 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-96eac1cb-766b-4e62-bf42-7b8492c46dc2 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:04.031271 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-96eac1cb-766b-4e62-bf42-7b8492c46dc2 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:04.031717 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-96eac1cb-766b-4e62-bf42-7b8492c46dc2 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:04.179348 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-96eac1cb-766b-4e62-bf42-7b8492c46dc2 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a24491b2e4545e289fa4f1cff4f30d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ab649bf434f78b83122111ec19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:04.188974 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-96eac1cb-766b-4e62-bf42-7b8492c46dc2 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] 10.222.0.59 "GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d" status: 200 len: 1358 microversion: 2.1 time: 0.170803 Jun 30 10:50:04.193917 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 464/924] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:50:04 2022] GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:50:04.802211 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-916e4681-65d2-4755-8690-543daea66111 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:04.803074 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-916e4681-65d2-4755-8690-543daea66111 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:04.809997 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-916e4681-65d2-4755-8690-543daea66111 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:04.810438 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-916e4681-65d2-4755-8690-543daea66111 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:04.811230 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-916e4681-65d2-4755-8690-543daea66111 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:04.811664 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-916e4681-65d2-4755-8690-543daea66111 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:04.957115 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-916e4681-65d2-4755-8690-543daea66111 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:04.966119 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-916e4681-65d2-4755-8690-543daea66111 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:04.967706 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-916e4681-65d2-4755-8690-543daea66111 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:04.968994 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-916e4681-65d2-4755-8690-543daea66111 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224" status: 200 len: 1737 microversion: 2.20 time: 0.170948 Jun 30 10:50:04.969631 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 461/925] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:50:04 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 => generated 1737 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:50:05.206338 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-8e5820cb-4762-409f-acad-013d0a7733fc tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:05.207094 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-8e5820cb-4762-409f-acad-013d0a7733fc tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] [instance: 6526331b-07d9-4ae7-8429-187bf752923d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:05.214405 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-8e5820cb-4762-409f-acad-013d0a7733fc tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:05.214867 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-8e5820cb-4762-409f-acad-013d0a7733fc tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:05.215631 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-8e5820cb-4762-409f-acad-013d0a7733fc tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:05.216063 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-8e5820cb-4762-409f-acad-013d0a7733fc tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:05.362039 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-8e5820cb-4762-409f-acad-013d0a7733fc tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a24491b2e4545e289fa4f1cff4f30d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ab649bf434f78b83122111ec19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:05.370002 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-8e5820cb-4762-409f-acad-013d0a7733fc tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] 10.222.0.59 "GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d" status: 200 len: 1358 microversion: 2.1 time: 0.167662 Jun 30 10:50:05.370578 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 465/926] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:50:05 2022] GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:50:05.987621 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-bcee5359-2ad4-46e7-a180-6031c0fddb1b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:05.988325 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-bcee5359-2ad4-46e7-a180-6031c0fddb1b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:05.995204 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-bcee5359-2ad4-46e7-a180-6031c0fddb1b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:05.995653 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-bcee5359-2ad4-46e7-a180-6031c0fddb1b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:05.996449 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-bcee5359-2ad4-46e7-a180-6031c0fddb1b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:05.996938 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-bcee5359-2ad4-46e7-a180-6031c0fddb1b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:06.132798 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-bcee5359-2ad4-46e7-a180-6031c0fddb1b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:06.141347 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-bcee5359-2ad4-46e7-a180-6031c0fddb1b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:06.142868 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-bcee5359-2ad4-46e7-a180-6031c0fddb1b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:06.144027 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-bcee5359-2ad4-46e7-a180-6031c0fddb1b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224" status: 200 len: 1737 microversion: 2.20 time: 0.160468 Jun 30 10:50:06.153034 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 462/927] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:50:05 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 => generated 1737 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:50:06.387340 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-d4ecfc43-a4af-4c1b-a33d-7c854de2d374 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:06.387979 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-d4ecfc43-a4af-4c1b-a33d-7c854de2d374 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] [instance: 6526331b-07d9-4ae7-8429-187bf752923d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:06.394564 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-d4ecfc43-a4af-4c1b-a33d-7c854de2d374 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:06.395019 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-d4ecfc43-a4af-4c1b-a33d-7c854de2d374 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:06.395785 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-d4ecfc43-a4af-4c1b-a33d-7c854de2d374 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:06.396220 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-d4ecfc43-a4af-4c1b-a33d-7c854de2d374 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:06.533164 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-d4ecfc43-a4af-4c1b-a33d-7c854de2d374 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a24491b2e4545e289fa4f1cff4f30d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ab649bf434f78b83122111ec19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:06.541592 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-d4ecfc43-a4af-4c1b-a33d-7c854de2d374 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] 10.222.0.59 "GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d" status: 200 len: 1358 microversion: 2.1 time: 0.158143 Jun 30 10:50:06.542262 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 466/928] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:50:06 2022] GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:50:07.163202 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-13434cc9-15e4-4a1c-8ddf-f6eb5c838601 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:07.163834 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-13434cc9-15e4-4a1c-8ddf-f6eb5c838601 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:07.165771 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_cell0:SELECT=2 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:50:07.166625 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_cell0:SELECT=6 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:50:07.175475 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-13434cc9-15e4-4a1c-8ddf-f6eb5c838601 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:07.175925 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-13434cc9-15e4-4a1c-8ddf-f6eb5c838601 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:07.176724 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-13434cc9-15e4-4a1c-8ddf-f6eb5c838601 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:07.177157 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-13434cc9-15e4-4a1c-8ddf-f6eb5c838601 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:07.306529 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-13434cc9-15e4-4a1c-8ddf-f6eb5c838601 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:07.314590 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-13434cc9-15e4-4a1c-8ddf-f6eb5c838601 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:07.316077 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-13434cc9-15e4-4a1c-8ddf-f6eb5c838601 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:07.317269 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-13434cc9-15e4-4a1c-8ddf-f6eb5c838601 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224" status: 200 len: 1737 microversion: 2.20 time: 0.158682 Jun 30 10:50:07.317837 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 463/929] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:50:07 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:50:07.558107 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-a8d3bd33-bb87-4ecb-835f-df4c34a27f08 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:07.558708 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-a8d3bd33-bb87-4ecb-835f-df4c34a27f08 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] [instance: 6526331b-07d9-4ae7-8429-187bf752923d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:07.560528 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_cell0:SELECT=6 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:50:07.566017 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a8d3bd33-bb87-4ecb-835f-df4c34a27f08 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:07.566569 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a8d3bd33-bb87-4ecb-835f-df4c34a27f08 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:07.567301 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a8d3bd33-bb87-4ecb-835f-df4c34a27f08 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:07.567732 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a8d3bd33-bb87-4ecb-835f-df4c34a27f08 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:07.694585 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-a8d3bd33-bb87-4ecb-835f-df4c34a27f08 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a24491b2e4545e289fa4f1cff4f30d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ab649bf434f78b83122111ec19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:07.701822 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-a8d3bd33-bb87-4ecb-835f-df4c34a27f08 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] 10.222.0.59 "GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d" status: 200 len: 1358 microversion: 2.1 time: 0.147581 Jun 30 10:50:07.702383 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 467/930] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:50:07 2022] GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:50:08.336850 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-5277bfb1-1d2c-4093-a4f7-86b9f553e790 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:08.337391 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-5277bfb1-1d2c-4093-a4f7-86b9f553e790 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:08.343858 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5277bfb1-1d2c-4093-a4f7-86b9f553e790 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:08.344297 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5277bfb1-1d2c-4093-a4f7-86b9f553e790 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:08.345086 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5277bfb1-1d2c-4093-a4f7-86b9f553e790 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:08.345512 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5277bfb1-1d2c-4093-a4f7-86b9f553e790 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:08.478057 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-5277bfb1-1d2c-4093-a4f7-86b9f553e790 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:08.486168 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-5277bfb1-1d2c-4093-a4f7-86b9f553e790 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:08.487657 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-5277bfb1-1d2c-4093-a4f7-86b9f553e790 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:08.488838 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-5277bfb1-1d2c-4093-a4f7-86b9f553e790 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224" status: 200 len: 1737 microversion: 2.20 time: 0.155962 Jun 30 10:50:08.489397 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 464/931] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:50:08 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:50:08.718394 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-eb6685f3-12f2-43ef-bab0-a586fd658393 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:08.719009 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-eb6685f3-12f2-43ef-bab0-a586fd658393 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] [instance: 6526331b-07d9-4ae7-8429-187bf752923d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:08.726030 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-eb6685f3-12f2-43ef-bab0-a586fd658393 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:08.726474 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-eb6685f3-12f2-43ef-bab0-a586fd658393 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:08.727231 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-eb6685f3-12f2-43ef-bab0-a586fd658393 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:08.727664 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-eb6685f3-12f2-43ef-bab0-a586fd658393 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:08.852404 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-eb6685f3-12f2-43ef-bab0-a586fd658393 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a24491b2e4545e289fa4f1cff4f30d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ab649bf434f78b83122111ec19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:08.860629 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-eb6685f3-12f2-43ef-bab0-a586fd658393 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] 10.222.0.59 "GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d" status: 200 len: 1358 microversion: 2.1 time: 0.146100 Jun 30 10:50:08.861197 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 468/932] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:50:08 2022] GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:50:09.507677 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-c727d307-799a-4419-a689-edd0be2a6078 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:09.508228 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-c727d307-799a-4419-a689-edd0be2a6078 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:09.514719 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c727d307-799a-4419-a689-edd0be2a6078 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:09.515170 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c727d307-799a-4419-a689-edd0be2a6078 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:09.515928 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c727d307-799a-4419-a689-edd0be2a6078 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:09.516364 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c727d307-799a-4419-a689-edd0be2a6078 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:09.846422 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-c727d307-799a-4419-a689-edd0be2a6078 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:09.854315 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-c727d307-799a-4419-a689-edd0be2a6078 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:09.855806 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-c727d307-799a-4419-a689-edd0be2a6078 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:09.857000 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-c727d307-799a-4419-a689-edd0be2a6078 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224" status: 200 len: 1737 microversion: 2.20 time: 0.353818 Jun 30 10:50:09.857570 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 465/933] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:50:09 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 => generated 1737 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:50:09.877819 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-ba2a2f78-bb29-4b15-a186-801af5ee3283 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:09.878433 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-ba2a2f78-bb29-4b15-a186-801af5ee3283 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] [instance: 6526331b-07d9-4ae7-8429-187bf752923d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:09.885684 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ba2a2f78-bb29-4b15-a186-801af5ee3283 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:09.886134 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ba2a2f78-bb29-4b15-a186-801af5ee3283 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:09.886895 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ba2a2f78-bb29-4b15-a186-801af5ee3283 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:09.887333 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ba2a2f78-bb29-4b15-a186-801af5ee3283 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:10.010912 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-ba2a2f78-bb29-4b15-a186-801af5ee3283 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a24491b2e4545e289fa4f1cff4f30d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ab649bf434f78b83122111ec19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:10.018449 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-ba2a2f78-bb29-4b15-a186-801af5ee3283 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] 10.222.0.59 "GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d" status: 200 len: 1358 microversion: 2.1 time: 0.144590 Jun 30 10:50:10.019016 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 469/934] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:50:09 2022] GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d => generated 1358 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:50:10.875574 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-c6f5e532-f3b6-428a-9cb3-b447a91b89d6 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:10.876192 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-c6f5e532-f3b6-428a-9cb3-b447a91b89d6 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:10.882844 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c6f5e532-f3b6-428a-9cb3-b447a91b89d6 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:10.883293 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c6f5e532-f3b6-428a-9cb3-b447a91b89d6 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:10.884051 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c6f5e532-f3b6-428a-9cb3-b447a91b89d6 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:10.884485 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c6f5e532-f3b6-428a-9cb3-b447a91b89d6 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:11.017011 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-c6f5e532-f3b6-428a-9cb3-b447a91b89d6 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:11.025522 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-c6f5e532-f3b6-428a-9cb3-b447a91b89d6 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:11.027080 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-c6f5e532-f3b6-428a-9cb3-b447a91b89d6 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:11.028438 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-c6f5e532-f3b6-428a-9cb3-b447a91b89d6 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224" status: 200 len: 1737 microversion: 2.20 time: 0.156955 Jun 30 10:50:11.029080 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 466/935] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:50:10 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:50:11.044199 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-1927cd46-b7a2-4797-9e51-440e4249bfa5 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:11.044904 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-1927cd46-b7a2-4797-9e51-440e4249bfa5 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] [instance: 6526331b-07d9-4ae7-8429-187bf752923d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:11.051428 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-1927cd46-b7a2-4797-9e51-440e4249bfa5 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:11.051956 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-1927cd46-b7a2-4797-9e51-440e4249bfa5 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:11.052807 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-1927cd46-b7a2-4797-9e51-440e4249bfa5 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:11.053311 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-1927cd46-b7a2-4797-9e51-440e4249bfa5 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:11.179895 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-1927cd46-b7a2-4797-9e51-440e4249bfa5 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a24491b2e4545e289fa4f1cff4f30d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ab649bf434f78b83122111ec19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:11.187327 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-1927cd46-b7a2-4797-9e51-440e4249bfa5 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] 10.222.0.59 "GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d" status: 200 len: 1358 microversion: 2.1 time: 0.146994 Jun 30 10:50:11.188136 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 470/936] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:50:11 2022] GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:50:11.529911 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [req-eb678dc3-6edf-4a8a-8d51-b287883c0e11 req-6702ecf8-b474-4d26-a217-1e2b7ecde089 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6526331b-07d9-4ae7-8429-187bf752923d", "tag": "1ba7efd4-5bb9-4ada-b21b-02272e12a627"}]} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:50:11.538360 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-eb678dc3-6edf-4a8a-8d51-b287883c0e11 req-6702ecf8-b474-4d26-a217-1e2b7ecde089 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:11.538930 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-eb678dc3-6edf-4a8a-8d51-b287883c0e11 req-6702ecf8-b474-4d26-a217-1e2b7ecde089 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:11.550563 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.compute.server_external_events [req-eb678dc3-6edf-4a8a-8d51-b287883c0e11 req-6702ecf8-b474-4d26-a217-1e2b7ecde089 service nova] Creating event network-changed:1ba7efd4-5bb9-4ada-b21b-02272e12a627 for instance 6526331b-07d9-4ae7-8429-187bf752923d on hv-cinder-82282 Jun 30 10:50:11.558010 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [req-eb678dc3-6edf-4a8a-8d51-b287883c0e11 req-6702ecf8-b474-4d26-a217-1e2b7ecde089 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030655 Jun 30 10:50:11.558827 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 467/937] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:50:12.046809 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-ee37ff20-c9b7-4f7b-85db-45c3d255639c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:12.047348 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-ee37ff20-c9b7-4f7b-85db-45c3d255639c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:12.053788 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ee37ff20-c9b7-4f7b-85db-45c3d255639c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:12.054241 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ee37ff20-c9b7-4f7b-85db-45c3d255639c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:12.055008 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ee37ff20-c9b7-4f7b-85db-45c3d255639c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:12.055475 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ee37ff20-c9b7-4f7b-85db-45c3d255639c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:12.190870 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-ee37ff20-c9b7-4f7b-85db-45c3d255639c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:12.199096 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-ee37ff20-c9b7-4f7b-85db-45c3d255639c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:12.206994 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-bfb98edc-499e-4d00-94bb-03315cc2a16b tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:12.208785 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-bfb98edc-499e-4d00-94bb-03315cc2a16b tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] [instance: 6526331b-07d9-4ae7-8429-187bf752923d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:12.212892 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-ee37ff20-c9b7-4f7b-85db-45c3d255639c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:12.214095 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-ee37ff20-c9b7-4f7b-85db-45c3d255639c tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224" status: 200 len: 1737 microversion: 2.20 time: 0.171350 Jun 30 10:50:12.214652 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 471/938] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:50:12 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 => generated 1737 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:50:12.216869 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-bfb98edc-499e-4d00-94bb-03315cc2a16b tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:12.217317 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-bfb98edc-499e-4d00-94bb-03315cc2a16b tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:12.218084 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-bfb98edc-499e-4d00-94bb-03315cc2a16b tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:12.218516 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-bfb98edc-499e-4d00-94bb-03315cc2a16b tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:12.356673 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-bfb98edc-499e-4d00-94bb-03315cc2a16b tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a24491b2e4545e289fa4f1cff4f30d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ab649bf434f78b83122111ec19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:12.366771 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-bfb98edc-499e-4d00-94bb-03315cc2a16b tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] 10.222.0.59 "GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d" status: 200 len: 1358 microversion: 2.1 time: 0.165835 Jun 30 10:50:12.372555 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 468/939] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:50:12 2022] GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:50:12.715145 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-eb01c3f0-afdc-4c85-b1c2-4973086ca02b tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4989d6a1-355d-4a47-8639-7040b0785c98"}} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:50:12.716254 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-eb01c3f0-afdc-4c85-b1c2-4973086ca02b tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 5729f9ae-3c4d-490a-9501-b4806724de9d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:12.722204 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-eb01c3f0-afdc-4c85-b1c2-4973086ca02b tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:12.722645 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-eb01c3f0-afdc-4c85-b1c2-4973086ca02b tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:12.723403 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-eb01c3f0-afdc-4c85-b1c2-4973086ca02b tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:12.723855 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-eb01c3f0-afdc-4c85-b1c2-4973086ca02b tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:12.807270 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.wsgi [None req-eb01c3f0-afdc-4c85-b1c2-4973086ca02b tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] HTTP exception thrown: Invalid volume: volume 4989d6a1-355d-4a47-8639-7040b0785c98 is already attached to instances: 5729f9ae-3c4d-490a-9501-b4806724de9d Jun 30 10:50:12.809053 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-eb01c3f0-afdc-4c85-b1c2-4973086ca02b tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Request method failure captured: Jun 30 10:50:12.809053 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: request: POST /compute/v2.1/servers/5729f9ae-3c4d-490a-9501-b4806724de9d/os-volume_attachments HTTP/1.1 Jun 30 10:50:12.809053 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Accept: application/json Jun 30 10:50:12.809053 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Accept-Encoding: identity Jun 30 10:50:12.809053 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Connection: close Jun 30 10:50:12.809053 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Content-Length: 74 Jun 30 10:50:12.809053 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Content-Type: application/json Jun 30 10:50:12.809053 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Host: 10.222.0.59 Jun 30 10:50:12.809053 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Openstack-System-Scope: None Jun 30 10:50:12.809053 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: User-Agent: python-urllib3/1.26.9 Jun 30 10:50:12.809053 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Auth-Token: gAAAAABivX2SDXLzZddWIKNVN1nlKFPwtYJlUUF8PxnvIHmdlvz3CWxsmmlutMh4nwIcp8e29jVTyW0L2PeVImDMIlnOZ-7kokNBpPBYwuv_h-8Q51jKjjG2cB0Se9mEglmc0BxaTnOJa9GnDeBKjS31T1Z6kscoN_FtN_Ly_k2htqmUscjC_wQ Jun 30 10:50:12.809053 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Domain-Id: None Jun 30 10:50:12.809053 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Domain-Name: None Jun 30 10:50:12.809053 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Identity-Status: Confirmed Jun 30 10:50:12.809053 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Is-Admin-Project: True Jun 30 10:50:12.809053 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Domain-Id: default Jun 30 10:50:12.809053 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Domain-Name: Default Jun 30 10:50:12.809053 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Id: 848d69e5041341488aafc3e6d26d491c Jun 30 10:50:12.809053 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Name: tempest-AttachVolumeNegativeTest-1311706498 Jun 30 10:50:12.809053 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Role: member,reader Jun 30 10:50:12.809053 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Roles: member,reader Jun 30 10:50:12.810448 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/848d69e5041341488aafc3e6d26d491c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_848d69e5041341488aafc3e6d26d491c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/848d69e5041341488aafc3e6d26d491c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/848d69e5041341488aafc3e6d26d491c"}]}] Jun 30 10:50:12.810448 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant: tempest-AttachVolumeNegativeTest-1311706498 Jun 30 10:50:12.810448 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant-Id: 848d69e5041341488aafc3e6d26d491c Jun 30 10:50:12.810448 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1311706498 Jun 30 10:50:12.810448 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User: tempest-AttachVolumeNegativeTest-1311706498-project Jun 30 10:50:12.810448 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Domain-Id: default Jun 30 10:50:12.810448 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Domain-Name: Default Jun 30 10:50:12.810448 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Id: d6a194d68415422fbc6ca75a8dbccf22 Jun 30 10:50:12.810448 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Name: tempest-AttachVolumeNegativeTest-1311706498-project Jun 30 10:50:12.810448 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Jun 30 10:50:12.810448 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: {"volumeAttachment": {"volumeId": "4989d6a1-355d-4a47-8639-7040b0785c98"}} Jun 30 10:50:12.810448 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: method: > Jun 30 10:50:12.811312 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: exception: Invalid volume: volume 4989d6a1-355d-4a47-8639-7040b0785c98 is already attached to instances: 5729f9ae-3c4d-490a-9501-b4806724de9d Jun 30 10:50:12.811312 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: action_args: {'server_id': '5729f9ae-3c4d-490a-9501-b4806724de9d', 'body': {'volumeAttachment': {'volumeId': '4989d6a1-355d-4a47-8639-7040b0785c98'}}} Jun 30 10:50:12.811312 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:50:12.811312 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:50:12.811312 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 30 10:50:12.811312 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 30 10:50:12.811312 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 30 10:50:12.811312 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 30 10:50:12.811312 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 30 10:50:12.811312 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 30 10:50:12.811312 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 30 10:50:12.811312 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 30 10:50:12.811312 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 30 10:50:12.811312 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 30 10:50:12.811312 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 4989d6a1-355d-4a47-8639-7040b0785c98 is already attached to instances: 5729f9ae-3c4d-490a-9501-b4806724de9d Jun 30 10:50:12.811312 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:50:12.811312 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:50:12.811312 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:50:12.811312 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:50:12.812891 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:50:12.812891 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:50:12.812891 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:50:12.812891 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:50:12.812891 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:50:12.812891 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:50:12.812891 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 30 10:50:12.812891 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 10:50:12.812891 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 30 10:50:12.812891 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 10:50:12.812891 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 30 10:50:12.812891 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 10:50:12.812891 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 30 10:50:12.812891 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 30 10:50:12.812891 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 4989d6a1-355d-4a47-8639-7040b0785c98 is already attached to instances: 5729f9ae-3c4d-490a-9501-b4806724de9d Jun 30 10:50:12.812891 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:50:12.812891 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:50:12.812891 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:50:12.812891 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:50:12.812891 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:50:12.814872 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:50:12.814872 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:50:12.814872 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:50:12.814872 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 4989d6a1-355d-4a47-8639-7040b0785c98 is already attached to instances: 5729f9ae-3c4d-490a-9501-b4806724de9d Jun 30 10:50:12.814872 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:50:12.814872 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-eb01c3f0-afdc-4c85-b1c2-4973086ca02b tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Returning 400 to user: Invalid volume: volume 4989d6a1-355d-4a47-8639-7040b0785c98 is already attached to instances: 5729f9ae-3c4d-490a-9501-b4806724de9d {{(pid=124203) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:50:12.814872 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-eb01c3f0-afdc-4c85-b1c2-4973086ca02b tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "POST /compute/v2.1/servers/5729f9ae-3c4d-490a-9501-b4806724de9d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099381 Jun 30 10:50:12.814872 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 472/940] 10.222.0.59 () {60 vars in 1322 bytes} [Thu Jun 30 10:50:12 2022] POST /compute/v2.1/servers/5729f9ae-3c4d-490a-9501-b4806724de9d/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 30 10:50:12.874166 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-0a2db24a-0d17-4784-9248-83b16cb1aa18 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:12.874554 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-0a2db24a-0d17-4784-9248-83b16cb1aa18 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 5729f9ae-3c4d-490a-9501-b4806724de9d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:12.881394 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-0a2db24a-0d17-4784-9248-83b16cb1aa18 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:12.881853 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-0a2db24a-0d17-4784-9248-83b16cb1aa18 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:12.882621 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-0a2db24a-0d17-4784-9248-83b16cb1aa18 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:12.883182 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-0a2db24a-0d17-4784-9248-83b16cb1aa18 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:12.966245 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.objects.instance [None req-0a2db24a-0d17-4784-9248-83b16cb1aa18 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lazy-loading 'services' on Instance uuid 5729f9ae-3c4d-490a-9501-b4806724de9d {{(pid=124204) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 10:50:13.037831 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-0a2db24a-0d17-4784-9248-83b16cb1aa18 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "DELETE /compute/v2.1/servers/5729f9ae-3c4d-490a-9501-b4806724de9d/os-volume_attachments/4989d6a1-355d-4a47-8639-7040b0785c98" status: 202 len: 0 microversion: 2.1 time: 0.167523 Jun 30 10:50:13.038648 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 469/941] 10.222.0.59 () {58 vars in 1415 bytes} [Thu Jun 30 10:50:12 2022] DELETE /compute/v2.1/servers/5729f9ae-3c4d-490a-9501-b4806724de9d/os-volume_attachments/4989d6a1-355d-4a47-8639-7040b0785c98 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 30 10:50:13.047373 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-4d31e5e6-a57c-4cd3-b61c-4f37001ca849 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:13.049301 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-4d31e5e6-a57c-4cd3-b61c-4f37001ca849 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 5729f9ae-3c4d-490a-9501-b4806724de9d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:13.058348 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-4d31e5e6-a57c-4cd3-b61c-4f37001ca849 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:13.059221 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-4d31e5e6-a57c-4cd3-b61c-4f37001ca849 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:13.060125 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-4d31e5e6-a57c-4cd3-b61c-4f37001ca849 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:13.060655 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-4d31e5e6-a57c-4cd3-b61c-4f37001ca849 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:13.098299 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-4d31e5e6-a57c-4cd3-b61c-4f37001ca849 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/5729f9ae-3c4d-490a-9501-b4806724de9d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055304 Jun 30 10:50:13.102626 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 473/942] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 30 10:50:13 2022] GET /compute/v2.1/servers/5729f9ae-3c4d-490a-9501-b4806724de9d/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:50:13.233921 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-02e987a5-45f0-4fcc-80e6-0db5612b5c2a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:13.234628 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-02e987a5-45f0-4fcc-80e6-0db5612b5c2a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:13.241951 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-02e987a5-45f0-4fcc-80e6-0db5612b5c2a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:13.242408 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-02e987a5-45f0-4fcc-80e6-0db5612b5c2a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:13.243183 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-02e987a5-45f0-4fcc-80e6-0db5612b5c2a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:13.243622 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-02e987a5-45f0-4fcc-80e6-0db5612b5c2a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:13.370598 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-02e987a5-45f0-4fcc-80e6-0db5612b5c2a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:13.378564 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-02e987a5-45f0-4fcc-80e6-0db5612b5c2a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:13.380066 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-02e987a5-45f0-4fcc-80e6-0db5612b5c2a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:13.381263 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-02e987a5-45f0-4fcc-80e6-0db5612b5c2a tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224" status: 200 len: 1719 microversion: 2.20 time: 0.151963 Jun 30 10:50:13.381862 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 470/943] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:50:13 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 => generated 1719 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:50:13.383200 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-d557d0e8-0026-4734-aed0-42ee2e1c9770 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:13.383812 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-d557d0e8-0026-4734-aed0-42ee2e1c9770 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] [instance: 6526331b-07d9-4ae7-8429-187bf752923d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:13.389772 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-d557d0e8-0026-4734-aed0-42ee2e1c9770 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:13.390217 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-d557d0e8-0026-4734-aed0-42ee2e1c9770 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:13.390980 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-d557d0e8-0026-4734-aed0-42ee2e1c9770 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:13.391420 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-d557d0e8-0026-4734-aed0-42ee2e1c9770 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:13.525002 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-d557d0e8-0026-4734-aed0-42ee2e1c9770 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a24491b2e4545e289fa4f1cff4f30d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ab649bf434f78b83122111ec19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:13.532355 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-d557d0e8-0026-4734-aed0-42ee2e1c9770 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] 10.222.0.59 "GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d" status: 200 len: 1358 microversion: 2.1 time: 0.153191 Jun 30 10:50:13.532955 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 474/944] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:50:13 2022] GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:50:14.110294 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-d180bda4-6f05-4fcd-b041-46a830c7782a tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:14.111262 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-d180bda4-6f05-4fcd-b041-46a830c7782a tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 5729f9ae-3c4d-490a-9501-b4806724de9d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:14.117306 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d180bda4-6f05-4fcd-b041-46a830c7782a tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:14.117750 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d180bda4-6f05-4fcd-b041-46a830c7782a tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:14.118503 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d180bda4-6f05-4fcd-b041-46a830c7782a tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:14.118932 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d180bda4-6f05-4fcd-b041-46a830c7782a tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:14.149202 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-d180bda4-6f05-4fcd-b041-46a830c7782a tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/5729f9ae-3c4d-490a-9501-b4806724de9d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043082 Jun 30 10:50:14.149759 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 471/945] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 30 10:50:14 2022] GET /compute/v2.1/servers/5729f9ae-3c4d-490a-9501-b4806724de9d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:50:14.399369 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-6592c11b-fe41-40fb-a8f9-536bfa4bd37e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:14.399962 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-6592c11b-fe41-40fb-a8f9-536bfa4bd37e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:14.406455 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-6592c11b-fe41-40fb-a8f9-536bfa4bd37e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:14.406886 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-6592c11b-fe41-40fb-a8f9-536bfa4bd37e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:14.407638 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-6592c11b-fe41-40fb-a8f9-536bfa4bd37e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:14.408065 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-6592c11b-fe41-40fb-a8f9-536bfa4bd37e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:14.535760 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-6592c11b-fe41-40fb-a8f9-536bfa4bd37e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:14.543495 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-6592c11b-fe41-40fb-a8f9-536bfa4bd37e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:14.545007 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-6592c11b-fe41-40fb-a8f9-536bfa4bd37e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:14.546154 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-6592c11b-fe41-40fb-a8f9-536bfa4bd37e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224" status: 200 len: 1719 microversion: 2.20 time: 0.150766 Jun 30 10:50:14.546702 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 475/946] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:50:14 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 => generated 1719 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:50:14.549746 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-5029cd20-a8b0-436b-982d-7e3234186912 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:14.550398 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-5029cd20-a8b0-436b-982d-7e3234186912 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] [instance: 6526331b-07d9-4ae7-8429-187bf752923d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:14.557404 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5029cd20-a8b0-436b-982d-7e3234186912 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:14.557856 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5029cd20-a8b0-436b-982d-7e3234186912 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:14.558619 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5029cd20-a8b0-436b-982d-7e3234186912 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:14.559051 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5029cd20-a8b0-436b-982d-7e3234186912 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:14.687564 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-5029cd20-a8b0-436b-982d-7e3234186912 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a24491b2e4545e289fa4f1cff4f30d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ab649bf434f78b83122111ec19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:14.695067 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-5029cd20-a8b0-436b-982d-7e3234186912 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] 10.222.0.59 "GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d" status: 200 len: 1358 microversion: 2.1 time: 0.149364 Jun 30 10:50:14.695635 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 472/947] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:50:14 2022] GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:50:14.880116 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [req-a41ac9d9-4b55-4805-ac5b-7335dfc89707 req-9474c65a-e6d2-4187-9081-538507e71f7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a6b5e16-473d-4317-8bf7-ee0df07cb224", "name": "network-vif-unplugged", "status": "completed", "tag": "616d9e47-3706-4db1-a51a-9e45603ab16c"}]} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:50:14.889663 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-a41ac9d9-4b55-4805-ac5b-7335dfc89707 req-9474c65a-e6d2-4187-9081-538507e71f7e service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:14.890276 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-a41ac9d9-4b55-4805-ac5b-7335dfc89707 req-9474c65a-e6d2-4187-9081-538507e71f7e service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:14.901277 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.compute.server_external_events [req-a41ac9d9-4b55-4805-ac5b-7335dfc89707 req-9474c65a-e6d2-4187-9081-538507e71f7e service nova] Creating event network-vif-unplugged:616d9e47-3706-4db1-a51a-9e45603ab16c for instance 7a6b5e16-473d-4317-8bf7-ee0df07cb224 on hv-cinder-82282 Jun 30 10:50:14.906675 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [req-a41ac9d9-4b55-4805-ac5b-7335dfc89707 req-9474c65a-e6d2-4187-9081-538507e71f7e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030761 Jun 30 10:50:14.907570 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 476/948] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:50:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:50:15.160721 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-a95366cf-5ba6-453f-936a-f4e30233c5bb tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:15.161719 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-a95366cf-5ba6-453f-936a-f4e30233c5bb tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 5729f9ae-3c4d-490a-9501-b4806724de9d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:15.168388 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a95366cf-5ba6-453f-936a-f4e30233c5bb tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:15.168862 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a95366cf-5ba6-453f-936a-f4e30233c5bb tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:15.169603 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a95366cf-5ba6-453f-936a-f4e30233c5bb tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:15.170025 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a95366cf-5ba6-453f-936a-f4e30233c5bb tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:15.197736 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-a95366cf-5ba6-453f-936a-f4e30233c5bb tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/5729f9ae-3c4d-490a-9501-b4806724de9d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040983 Jun 30 10:50:15.198207 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 473/949] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 30 10:50:15 2022] GET /compute/v2.1/servers/5729f9ae-3c4d-490a-9501-b4806724de9d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:50:15.564437 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-b09c23b7-2c21-45f8-8162-3861d32bc79f tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:15.565157 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-b09c23b7-2c21-45f8-8162-3861d32bc79f tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:15.572316 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b09c23b7-2c21-45f8-8162-3861d32bc79f tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:15.572792 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b09c23b7-2c21-45f8-8162-3861d32bc79f tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:15.573549 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b09c23b7-2c21-45f8-8162-3861d32bc79f tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:15.573982 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b09c23b7-2c21-45f8-8162-3861d32bc79f tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:15.700798 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-b09c23b7-2c21-45f8-8162-3861d32bc79f tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:15.708603 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-b09c23b7-2c21-45f8-8162-3861d32bc79f tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:15.710736 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-b09c23b7-2c21-45f8-8162-3861d32bc79f tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:15.711839 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-9df08c76-6c38-485c-8c3a-61decf9c3502 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:15.712282 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-b09c23b7-2c21-45f8-8162-3861d32bc79f tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224" status: 200 len: 1719 microversion: 2.20 time: 0.151853 Jun 30 10:50:15.712468 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-9df08c76-6c38-485c-8c3a-61decf9c3502 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] [instance: 6526331b-07d9-4ae7-8429-187bf752923d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:15.712739 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 477/950] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:50:15 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 => generated 1719 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:50:15.718880 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-9df08c76-6c38-485c-8c3a-61decf9c3502 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:15.719332 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-9df08c76-6c38-485c-8c3a-61decf9c3502 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:15.720095 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-9df08c76-6c38-485c-8c3a-61decf9c3502 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:15.720559 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-9df08c76-6c38-485c-8c3a-61decf9c3502 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:15.850572 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-9df08c76-6c38-485c-8c3a-61decf9c3502 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a24491b2e4545e289fa4f1cff4f30d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ab649bf434f78b83122111ec19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:15.858332 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-9df08c76-6c38-485c-8c3a-61decf9c3502 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] 10.222.0.59 "GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d" status: 200 len: 1358 microversion: 2.1 time: 0.150670 Jun 30 10:50:15.858902 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 474/951] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:50:15 2022] GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:50:16.209037 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-80d92cb0-afc4-4685-af81-87c43d96a69e tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:16.209981 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-80d92cb0-afc4-4685-af81-87c43d96a69e tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 5729f9ae-3c4d-490a-9501-b4806724de9d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:16.215892 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-80d92cb0-afc4-4685-af81-87c43d96a69e tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:16.216330 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-80d92cb0-afc4-4685-af81-87c43d96a69e tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:16.217109 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-80d92cb0-afc4-4685-af81-87c43d96a69e tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:16.217533 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-80d92cb0-afc4-4685-af81-87c43d96a69e tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:16.246467 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-80d92cb0-afc4-4685-af81-87c43d96a69e tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/5729f9ae-3c4d-490a-9501-b4806724de9d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041334 Jun 30 10:50:16.247000 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 478/952] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 30 10:50:16 2022] GET /compute/v2.1/servers/5729f9ae-3c4d-490a-9501-b4806724de9d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:50:16.730403 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-c6337335-53e3-44e9-802a-5d4295949b61 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:16.731029 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-c6337335-53e3-44e9-802a-5d4295949b61 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:16.737798 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c6337335-53e3-44e9-802a-5d4295949b61 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:16.738252 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c6337335-53e3-44e9-802a-5d4295949b61 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:16.739034 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c6337335-53e3-44e9-802a-5d4295949b61 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:16.739450 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c6337335-53e3-44e9-802a-5d4295949b61 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:16.864900 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-c6337335-53e3-44e9-802a-5d4295949b61 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:16.867211 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:50:16.874903 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-c6337335-53e3-44e9-802a-5d4295949b61 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:16.875639 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-77c3d43a-a749-4984-b122-e4a324233010 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:16.876252 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-77c3d43a-a749-4984-b122-e4a324233010 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] [instance: 6526331b-07d9-4ae7-8429-187bf752923d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:16.876413 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-c6337335-53e3-44e9-802a-5d4295949b61 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:16.877670 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-c6337335-53e3-44e9-802a-5d4295949b61 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224" status: 200 len: 1719 microversion: 2.20 time: 0.151201 Jun 30 10:50:16.878236 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 475/953] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:50:16 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 => generated 1719 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:50:16.883624 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-77c3d43a-a749-4984-b122-e4a324233010 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:16.884084 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-77c3d43a-a749-4984-b122-e4a324233010 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:16.885048 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-77c3d43a-a749-4984-b122-e4a324233010 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:16.885500 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-77c3d43a-a749-4984-b122-e4a324233010 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:17.012516 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-77c3d43a-a749-4984-b122-e4a324233010 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a24491b2e4545e289fa4f1cff4f30d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ab649bf434f78b83122111ec19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:17.020015 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-77c3d43a-a749-4984-b122-e4a324233010 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] 10.222.0.59 "GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d" status: 200 len: 1358 microversion: 2.1 time: 0.148787 Jun 30 10:50:17.020601 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 479/954] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:50:16 2022] GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:50:17.258821 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-0e8e378d-6acd-40da-aa21-5bc66f5206d5 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:17.259752 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-0e8e378d-6acd-40da-aa21-5bc66f5206d5 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 5729f9ae-3c4d-490a-9501-b4806724de9d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:17.266204 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-0e8e378d-6acd-40da-aa21-5bc66f5206d5 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:17.267427 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-0e8e378d-6acd-40da-aa21-5bc66f5206d5 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:17.268208 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-0e8e378d-6acd-40da-aa21-5bc66f5206d5 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:17.268763 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-0e8e378d-6acd-40da-aa21-5bc66f5206d5 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:17.300455 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-0e8e378d-6acd-40da-aa21-5bc66f5206d5 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/5729f9ae-3c4d-490a-9501-b4806724de9d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046305 Jun 30 10:50:17.301062 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 476/955] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 30 10:50:17 2022] GET /compute/v2.1/servers/5729f9ae-3c4d-490a-9501-b4806724de9d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:50:18.027269 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-0da45058-ac1e-4e0f-ae85-ead5701f9efc tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:18.027910 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-0da45058-ac1e-4e0f-ae85-ead5701f9efc tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:18.037777 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-85ee3b30-17c5-483c-b9eb-f65e9a5e6d61 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:18.038407 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-85ee3b30-17c5-483c-b9eb-f65e9a5e6d61 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] [instance: 6526331b-07d9-4ae7-8429-187bf752923d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:18.043135 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0da45058-ac1e-4e0f-ae85-ead5701f9efc tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:18.043652 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0da45058-ac1e-4e0f-ae85-ead5701f9efc tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:18.044542 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0da45058-ac1e-4e0f-ae85-ead5701f9efc tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:18.045045 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0da45058-ac1e-4e0f-ae85-ead5701f9efc tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:18.045534 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-85ee3b30-17c5-483c-b9eb-f65e9a5e6d61 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:18.045990 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-85ee3b30-17c5-483c-b9eb-f65e9a5e6d61 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:18.046764 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-85ee3b30-17c5-483c-b9eb-f65e9a5e6d61 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:18.047201 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-85ee3b30-17c5-483c-b9eb-f65e9a5e6d61 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:18.243483 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-0da45058-ac1e-4e0f-ae85-ead5701f9efc tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:18.245825 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_cell1:SELECT=100 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:50:18.246355 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-85ee3b30-17c5-483c-b9eb-f65e9a5e6d61 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a24491b2e4545e289fa4f1cff4f30d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ab649bf434f78b83122111ec19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:18.252870 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-0da45058-ac1e-4e0f-ae85-ead5701f9efc tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:18.254290 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-85ee3b30-17c5-483c-b9eb-f65e9a5e6d61 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] 10.222.0.59 "GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d" status: 200 len: 1358 microversion: 2.1 time: 0.220443 Jun 30 10:50:18.254454 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-0da45058-ac1e-4e0f-ae85-ead5701f9efc tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:18.254871 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 477/956] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:50:18 2022] GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d => generated 1358 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:50:18.256616 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-0da45058-ac1e-4e0f-ae85-ead5701f9efc tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224" status: 200 len: 1662 microversion: 2.20 time: 0.363293 Jun 30 10:50:18.257391 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 480/957] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:50:17 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 => generated 1662 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:50:18.273998 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-ef13fdf2-c698-46fd-a0da-9212b8142d63 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1646d3c5-8d64-4c0a-891c-73a51f1fb026"}} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:50:18.275041 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-ef13fdf2-c698-46fd-a0da-9212b8142d63 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:18.280945 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ef13fdf2-c698-46fd-a0da-9212b8142d63 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:18.281385 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ef13fdf2-c698-46fd-a0da-9212b8142d63 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:18.282136 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ef13fdf2-c698-46fd-a0da-9212b8142d63 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:18.282562 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ef13fdf2-c698-46fd-a0da-9212b8142d63 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:18.313583 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-302b49d7-1827-4751-b41c-8415bf6c2a30 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:18.314563 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-302b49d7-1827-4751-b41c-8415bf6c2a30 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 5729f9ae-3c4d-490a-9501-b4806724de9d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:18.321658 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-302b49d7-1827-4751-b41c-8415bf6c2a30 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:18.322111 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-302b49d7-1827-4751-b41c-8415bf6c2a30 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:18.322877 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-302b49d7-1827-4751-b41c-8415bf6c2a30 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:18.323319 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-302b49d7-1827-4751-b41c-8415bf6c2a30 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:18.351440 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-302b49d7-1827-4751-b41c-8415bf6c2a30 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/5729f9ae-3c4d-490a-9501-b4806724de9d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041934 Jun 30 10:50:18.351998 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 481/958] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 30 10:50:18 2022] GET /compute/v2.1/servers/5729f9ae-3c4d-490a-9501-b4806724de9d/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 30 10:50:18.413920 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-6dd40fad-6d61-49a8-8915-8c5917c79e54 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:18.414548 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-6dd40fad-6d61-49a8-8915-8c5917c79e54 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 5729f9ae-3c4d-490a-9501-b4806724de9d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:18.420498 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-6dd40fad-6d61-49a8-8915-8c5917c79e54 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:18.420995 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-6dd40fad-6d61-49a8-8915-8c5917c79e54 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:18.421733 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-6dd40fad-6d61-49a8-8915-8c5917c79e54 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:18.422169 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-6dd40fad-6d61-49a8-8915-8c5917c79e54 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:18.449347 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-6dd40fad-6d61-49a8-8915-8c5917c79e54 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 5729f9ae-3c4d-490a-9501-b4806724de9d] Going to try to terminate instance {{(pid=124203) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 10:50:18.528764 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-6dd40fad-6d61-49a8-8915-8c5917c79e54 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "DELETE /compute/v2.1/servers/5729f9ae-3c4d-490a-9501-b4806724de9d" status: 204 len: 0 microversion: 2.1 time: 0.118887 Jun 30 10:50:18.529695 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 482/959] 10.222.0.59 () {58 vars in 1238 bytes} [Thu Jun 30 10:50:18 2022] DELETE /compute/v2.1/servers/5729f9ae-3c4d-490a-9501-b4806724de9d => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 30 10:50:18.538609 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-7a607b57-3cdc-43ad-9e43-26ff0c1bb57c tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:18.539319 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-7a607b57-3cdc-43ad-9e43-26ff0c1bb57c tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 5729f9ae-3c4d-490a-9501-b4806724de9d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:18.545118 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-7a607b57-3cdc-43ad-9e43-26ff0c1bb57c tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:18.545563 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-7a607b57-3cdc-43ad-9e43-26ff0c1bb57c tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:18.546316 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-7a607b57-3cdc-43ad-9e43-26ff0c1bb57c tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:18.546744 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-7a607b57-3cdc-43ad-9e43-26ff0c1bb57c tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:18.571300 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-ef13fdf2-c698-46fd-a0da-9212b8142d63 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "POST /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.301108 Jun 30 10:50:18.571912 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 478/960] 10.222.0.59 () {62 vars in 1363 bytes} [Thu Jun 30 10:50:18 2022] POST /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224/os-volume_attachments => generated 188 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 10:50:18.680699 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-7a607b57-3cdc-43ad-9e43-26ff0c1bb57c tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:18.685595 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-ea05f8ff-e15b-4eef-8da1-c49e8eb0f0c2 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:18.686097 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-ea05f8ff-e15b-4eef-8da1-c49e8eb0f0c2 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:18.688245 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-7a607b57-3cdc-43ad-9e43-26ff0c1bb57c tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/5729f9ae-3c4d-490a-9501-b4806724de9d" status: 200 len: 1682 microversion: 2.1 time: 0.154207 Jun 30 10:50:18.688844 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 483/961] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:50:18 2022] GET /compute/v2.1/servers/5729f9ae-3c4d-490a-9501-b4806724de9d => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:50:18.692152 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ea05f8ff-e15b-4eef-8da1-c49e8eb0f0c2 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:18.692635 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ea05f8ff-e15b-4eef-8da1-c49e8eb0f0c2 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:18.693410 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ea05f8ff-e15b-4eef-8da1-c49e8eb0f0c2 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:18.693870 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ea05f8ff-e15b-4eef-8da1-c49e8eb0f0c2 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:18.915037 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-ea05f8ff-e15b-4eef-8da1-c49e8eb0f0c2 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "DELETE /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224/os-volume_attachments/1646d3c5-8d64-4c0a-891c-73a51f1fb026" status: 202 len: 0 microversion: 2.20 time: 0.233209 Jun 30 10:50:18.915620 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 479/962] 10.222.0.59 () {60 vars in 1456 bytes} [Thu Jun 30 10:50:18 2022] DELETE /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224/os-volume_attachments/1646d3c5-8d64-4c0a-891c-73a51f1fb026 => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 30 10:50:18.973682 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-26180b70-3956-40de-9af8-27ce3ab6c3e2 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:50:18.974230 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-26180b70-3956-40de-9af8-27ce3ab6c3e2 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:18.981368 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-26180b70-3956-40de-9af8-27ce3ab6c3e2 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:18.981818 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-26180b70-3956-40de-9af8-27ce3ab6c3e2 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:18.982588 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-26180b70-3956-40de-9af8-27ce3ab6c3e2 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:18.983279 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-26180b70-3956-40de-9af8-27ce3ab6c3e2 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:19.059010 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-26180b70-3956-40de-9af8-27ce3ab6c3e2 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "POST /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224/action" status: 202 len: 0 microversion: 2.20 time: 0.089336 Jun 30 10:50:19.059927 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 484/963] 10.222.0.59 () {62 vars in 1318 bytes} [Thu Jun 30 10:50:18 2022] POST /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 30 10:50:19.069305 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-6e8ec131-8023-40cc-bf9b-158ff86e2f5f tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:19.069944 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-6e8ec131-8023-40cc-bf9b-158ff86e2f5f tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:19.076472 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6e8ec131-8023-40cc-bf9b-158ff86e2f5f tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:19.077452 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6e8ec131-8023-40cc-bf9b-158ff86e2f5f tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:19.078233 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6e8ec131-8023-40cc-bf9b-158ff86e2f5f tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:19.078667 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6e8ec131-8023-40cc-bf9b-158ff86e2f5f tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:19.215577 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-6e8ec131-8023-40cc-bf9b-158ff86e2f5f tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:19.224735 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-6e8ec131-8023-40cc-bf9b-158ff86e2f5f tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:19.226139 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-6e8ec131-8023-40cc-bf9b-158ff86e2f5f tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:19.227341 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-6e8ec131-8023-40cc-bf9b-158ff86e2f5f tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224" status: 200 len: 1670 microversion: 2.20 time: 0.161994 Jun 30 10:50:19.227896 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 480/964] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:50:19 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 => generated 1670 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 10:50:19.272373 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-0e9be030-9723-44b9-85d7-9b69fa8b00bb tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:19.273041 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-0e9be030-9723-44b9-85d7-9b69fa8b00bb tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] [instance: 6526331b-07d9-4ae7-8429-187bf752923d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:19.279487 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0e9be030-9723-44b9-85d7-9b69fa8b00bb tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:19.279943 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0e9be030-9723-44b9-85d7-9b69fa8b00bb tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:19.280747 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0e9be030-9723-44b9-85d7-9b69fa8b00bb tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:19.281182 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0e9be030-9723-44b9-85d7-9b69fa8b00bb tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:19.412607 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-0e9be030-9723-44b9-85d7-9b69fa8b00bb tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a24491b2e4545e289fa4f1cff4f30d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ab649bf434f78b83122111ec19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:19.420099 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-0e9be030-9723-44b9-85d7-9b69fa8b00bb tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] 10.222.0.59 "GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d" status: 200 len: 1358 microversion: 2.1 time: 0.152477 Jun 30 10:50:19.420752 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 485/965] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:50:19 2022] GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:50:19.704823 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-c6e43398-b201-40d0-8313-aaf2d4cc9a0d tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:19.705451 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-c6e43398-b201-40d0-8313-aaf2d4cc9a0d tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 5729f9ae-3c4d-490a-9501-b4806724de9d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:19.711440 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c6e43398-b201-40d0-8313-aaf2d4cc9a0d tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:19.711889 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c6e43398-b201-40d0-8313-aaf2d4cc9a0d tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:19.712676 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c6e43398-b201-40d0-8313-aaf2d4cc9a0d tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:19.713109 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c6e43398-b201-40d0-8313-aaf2d4cc9a0d tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:19.844223 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-c6e43398-b201-40d0-8313-aaf2d4cc9a0d tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:19.852447 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-c6e43398-b201-40d0-8313-aaf2d4cc9a0d tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/5729f9ae-3c4d-490a-9501-b4806724de9d" status: 200 len: 1682 microversion: 2.1 time: 0.151371 Jun 30 10:50:19.853058 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 481/966] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:50:19 2022] GET /compute/v2.1/servers/5729f9ae-3c4d-490a-9501-b4806724de9d => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:50:20.246134 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-b7d8788d-82c4-49b1-ac56-ba52802a751e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:20.246666 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-b7d8788d-82c4-49b1-ac56-ba52802a751e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:20.253329 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b7d8788d-82c4-49b1-ac56-ba52802a751e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:20.253781 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b7d8788d-82c4-49b1-ac56-ba52802a751e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:20.254553 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b7d8788d-82c4-49b1-ac56-ba52802a751e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:20.254994 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b7d8788d-82c4-49b1-ac56-ba52802a751e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:20.386590 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-b7d8788d-82c4-49b1-ac56-ba52802a751e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:20.395181 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-b7d8788d-82c4-49b1-ac56-ba52802a751e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:20.396769 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-b7d8788d-82c4-49b1-ac56-ba52802a751e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:20.397914 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-b7d8788d-82c4-49b1-ac56-ba52802a751e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224" status: 200 len: 1728 microversion: 2.20 time: 0.155837 Jun 30 10:50:20.398466 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 486/967] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:50:20 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:50:20.435884 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-48872793-fb8e-42c9-8008-9f6a6b3ce4a2 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:20.436487 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-48872793-fb8e-42c9-8008-9f6a6b3ce4a2 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] [instance: 6526331b-07d9-4ae7-8429-187bf752923d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:20.442651 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-48872793-fb8e-42c9-8008-9f6a6b3ce4a2 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:20.443090 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-48872793-fb8e-42c9-8008-9f6a6b3ce4a2 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:20.444456 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-48872793-fb8e-42c9-8008-9f6a6b3ce4a2 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:20.444904 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-48872793-fb8e-42c9-8008-9f6a6b3ce4a2 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:20.576426 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-48872793-fb8e-42c9-8008-9f6a6b3ce4a2 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a24491b2e4545e289fa4f1cff4f30d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ab649bf434f78b83122111ec19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:20.583967 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-48872793-fb8e-42c9-8008-9f6a6b3ce4a2 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] 10.222.0.59 "GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d" status: 200 len: 1358 microversion: 2.1 time: 0.151957 Jun 30 10:50:20.584561 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 482/968] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:50:20 2022] GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:50:20.871206 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-933ebb32-2403-4ba4-9634-dc626842e261 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:20.871832 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-933ebb32-2403-4ba4-9634-dc626842e261 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 5729f9ae-3c4d-490a-9501-b4806724de9d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:20.878387 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-933ebb32-2403-4ba4-9634-dc626842e261 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:20.878844 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-933ebb32-2403-4ba4-9634-dc626842e261 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:20.879628 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-933ebb32-2403-4ba4-9634-dc626842e261 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:20.880072 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-933ebb32-2403-4ba4-9634-dc626842e261 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:20.973012 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [req-b28d93fb-0b7d-4bb2-a900-93ddbdfd2917 req-4050f0f8-9937-462e-9ed8-a86d716f2928 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6526331b-07d9-4ae7-8429-187bf752923d", "name": "network-vif-plugged", "status": "completed", "tag": "1ba7efd4-5bb9-4ada-b21b-02272e12a627"}]} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:50:20.981500 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-b28d93fb-0b7d-4bb2-a900-93ddbdfd2917 req-4050f0f8-9937-462e-9ed8-a86d716f2928 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:20.981934 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-b28d93fb-0b7d-4bb2-a900-93ddbdfd2917 req-4050f0f8-9937-462e-9ed8-a86d716f2928 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:20.994152 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.compute.server_external_events [req-b28d93fb-0b7d-4bb2-a900-93ddbdfd2917 req-4050f0f8-9937-462e-9ed8-a86d716f2928 service nova] Creating event network-vif-plugged:1ba7efd4-5bb9-4ada-b21b-02272e12a627 for instance 6526331b-07d9-4ae7-8429-187bf752923d on hv-cinder-82282 Jun 30 10:50:20.999336 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [req-b28d93fb-0b7d-4bb2-a900-93ddbdfd2917 req-4050f0f8-9937-462e-9ed8-a86d716f2928 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029751 Jun 30 10:50:21.000121 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 483/969] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:50:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 10:50:21.196961 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-933ebb32-2403-4ba4-9634-dc626842e261 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:21.204459 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-933ebb32-2403-4ba4-9634-dc626842e261 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/5729f9ae-3c4d-490a-9501-b4806724de9d" status: 200 len: 1682 microversion: 2.1 time: 0.337308 Jun 30 10:50:21.205059 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 487/970] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:50:20 2022] GET /compute/v2.1/servers/5729f9ae-3c4d-490a-9501-b4806724de9d => generated 1682 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:50:21.416346 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-79344e6a-4f50-4e73-9f8e-b85ae57ec919 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:21.417272 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-79344e6a-4f50-4e73-9f8e-b85ae57ec919 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:21.423458 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-79344e6a-4f50-4e73-9f8e-b85ae57ec919 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:21.423971 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-79344e6a-4f50-4e73-9f8e-b85ae57ec919 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:21.424757 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-79344e6a-4f50-4e73-9f8e-b85ae57ec919 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:21.425184 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-79344e6a-4f50-4e73-9f8e-b85ae57ec919 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:21.558933 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-79344e6a-4f50-4e73-9f8e-b85ae57ec919 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:21.567123 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-79344e6a-4f50-4e73-9f8e-b85ae57ec919 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:21.569152 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-79344e6a-4f50-4e73-9f8e-b85ae57ec919 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:21.570610 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-79344e6a-4f50-4e73-9f8e-b85ae57ec919 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224" status: 200 len: 1728 microversion: 2.20 time: 0.158765 Jun 30 10:50:21.571165 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 484/971] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:50:21 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:50:21.600861 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-a1f81564-ac0a-4411-a94a-dfc58c79a132 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:21.601481 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-a1f81564-ac0a-4411-a94a-dfc58c79a132 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] [instance: 6526331b-07d9-4ae7-8429-187bf752923d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:21.608180 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a1f81564-ac0a-4411-a94a-dfc58c79a132 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:21.608580 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a1f81564-ac0a-4411-a94a-dfc58c79a132 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:21.609347 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a1f81564-ac0a-4411-a94a-dfc58c79a132 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:21.609792 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a1f81564-ac0a-4411-a94a-dfc58c79a132 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:21.747525 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-a1f81564-ac0a-4411-a94a-dfc58c79a132 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a24491b2e4545e289fa4f1cff4f30d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ab649bf434f78b83122111ec19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:21.755092 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-a1f81564-ac0a-4411-a94a-dfc58c79a132 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] 10.222.0.59 "GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d" status: 200 len: 1358 microversion: 2.1 time: 0.158123 Jun 30 10:50:21.755655 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 488/972] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:50:21 2022] GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:50:22.017556 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [req-6d0f63f7-f6c5-4663-9400-1eb31c9bc4a6 req-9a7a4324-ee55-4967-a675-e6863df459fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5729f9ae-3c4d-490a-9501-b4806724de9d", "name": "network-vif-deleted", "tag": "29e0b489-762d-473c-8f72-86220ad3e1e4"}]} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:50:22.027369 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-6d0f63f7-f6c5-4663-9400-1eb31c9bc4a6 req-9a7a4324-ee55-4967-a675-e6863df459fc service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:22.027824 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-6d0f63f7-f6c5-4663-9400-1eb31c9bc4a6 req-9a7a4324-ee55-4967-a675-e6863df459fc service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:22.040488 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.compute.server_external_events [req-6d0f63f7-f6c5-4663-9400-1eb31c9bc4a6 req-9a7a4324-ee55-4967-a675-e6863df459fc service nova] Creating event network-vif-deleted:29e0b489-762d-473c-8f72-86220ad3e1e4 for instance 5729f9ae-3c4d-490a-9501-b4806724de9d on hv-cinder-82282 Jun 30 10:50:22.045789 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [req-6d0f63f7-f6c5-4663-9400-1eb31c9bc4a6 req-9a7a4324-ee55-4967-a675-e6863df459fc service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032039 Jun 30 10:50:22.046403 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 485/973] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:50:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:50:22.222298 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-ee12eebf-893b-4491-b438-cad02351156b tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:22.222822 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-ee12eebf-893b-4491-b438-cad02351156b tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 5729f9ae-3c4d-490a-9501-b4806724de9d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:22.228848 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ee12eebf-893b-4491-b438-cad02351156b tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:22.229240 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ee12eebf-893b-4491-b438-cad02351156b tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:22.229991 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ee12eebf-893b-4491-b438-cad02351156b tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:22.230419 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ee12eebf-893b-4491-b438-cad02351156b tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:22.294957 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-ee12eebf-893b-4491-b438-cad02351156b tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:22.302585 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-ee12eebf-893b-4491-b438-cad02351156b tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/5729f9ae-3c4d-490a-9501-b4806724de9d" status: 200 len: 1615 microversion: 2.1 time: 0.084167 Jun 30 10:50:22.303481 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 489/974] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:50:22 2022] GET /compute/v2.1/servers/5729f9ae-3c4d-490a-9501-b4806724de9d => generated 1615 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:50:22.591157 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-42d8b826-0945-4046-804f-39ab7cdedf92 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:22.591772 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-42d8b826-0945-4046-804f-39ab7cdedf92 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:22.598082 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-42d8b826-0945-4046-804f-39ab7cdedf92 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:22.598532 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-42d8b826-0945-4046-804f-39ab7cdedf92 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:22.599332 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-42d8b826-0945-4046-804f-39ab7cdedf92 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:22.599793 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-42d8b826-0945-4046-804f-39ab7cdedf92 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:22.739875 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-42d8b826-0945-4046-804f-39ab7cdedf92 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:22.749357 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-42d8b826-0945-4046-804f-39ab7cdedf92 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:22.750902 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-42d8b826-0945-4046-804f-39ab7cdedf92 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:22.752183 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-42d8b826-0945-4046-804f-39ab7cdedf92 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224" status: 200 len: 1728 microversion: 2.20 time: 0.165938 Jun 30 10:50:22.752786 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 486/975] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:50:22 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 => generated 1728 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:50:22.772319 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-09de623d-52e2-46e9-a584-b023cd5be051 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:22.773877 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-09de623d-52e2-46e9-a584-b023cd5be051 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] [instance: 6526331b-07d9-4ae7-8429-187bf752923d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:22.781175 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-09de623d-52e2-46e9-a584-b023cd5be051 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:22.781534 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-09de623d-52e2-46e9-a584-b023cd5be051 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:22.782404 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-09de623d-52e2-46e9-a584-b023cd5be051 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:22.782843 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-09de623d-52e2-46e9-a584-b023cd5be051 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:22.970757 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-09de623d-52e2-46e9-a584-b023cd5be051 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a24491b2e4545e289fa4f1cff4f30d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ab649bf434f78b83122111ec19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:22.978772 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-09de623d-52e2-46e9-a584-b023cd5be051 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] 10.222.0.59 "GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d" status: 200 len: 1358 microversion: 2.1 time: 0.211009 Jun 30 10:50:22.979368 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 490/976] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:50:22 2022] GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d => generated 1358 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:50:23.320352 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-547f9306-ecb5-4024-91aa-b3080d41df10 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:23.322079 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-547f9306-ecb5-4024-91aa-b3080d41df10 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 5729f9ae-3c4d-490a-9501-b4806724de9d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:23.328808 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-547f9306-ecb5-4024-91aa-b3080d41df10 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:23.329314 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-547f9306-ecb5-4024-91aa-b3080d41df10 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:23.330632 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-547f9306-ecb5-4024-91aa-b3080d41df10 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:23.331071 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-547f9306-ecb5-4024-91aa-b3080d41df10 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:23.495521 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.wsgi [None req-547f9306-ecb5-4024-91aa-b3080d41df10 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] HTTP exception thrown: Instance 5729f9ae-3c4d-490a-9501-b4806724de9d could not be found. Jun 30 10:50:23.497159 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-547f9306-ecb5-4024-91aa-b3080d41df10 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Request method failure captured: Jun 30 10:50:23.497159 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: request: GET /compute/v2.1/servers/5729f9ae-3c4d-490a-9501-b4806724de9d HTTP/1.1 Jun 30 10:50:23.497159 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Accept: application/json Jun 30 10:50:23.497159 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Accept-Encoding: identity Jun 30 10:50:23.497159 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Connection: close Jun 30 10:50:23.497159 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Content-Length: 0 Jun 30 10:50:23.497159 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Content-Type: application/json Jun 30 10:50:23.497159 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Host: 10.222.0.59 Jun 30 10:50:23.497159 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Openstack-System-Scope: None Jun 30 10:50:23.497159 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: User-Agent: python-urllib3/1.26.9 Jun 30 10:50:23.497159 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Auth-Token: gAAAAABivX2SDXLzZddWIKNVN1nlKFPwtYJlUUF8PxnvIHmdlvz3CWxsmmlutMh4nwIcp8e29jVTyW0L2PeVImDMIlnOZ-7kokNBpPBYwuv_h-8Q51jKjjG2cB0Se9mEglmc0BxaTnOJa9GnDeBKjS31T1Z6kscoN_FtN_Ly_k2htqmUscjC_wQ Jun 30 10:50:23.497159 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Domain-Id: None Jun 30 10:50:23.497159 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Domain-Name: None Jun 30 10:50:23.497159 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Identity-Status: Confirmed Jun 30 10:50:23.497159 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Is-Admin-Project: True Jun 30 10:50:23.497159 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Domain-Id: default Jun 30 10:50:23.497159 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Domain-Name: Default Jun 30 10:50:23.497159 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Id: 848d69e5041341488aafc3e6d26d491c Jun 30 10:50:23.497159 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Name: tempest-AttachVolumeNegativeTest-1311706498 Jun 30 10:50:23.497159 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Role: member,reader Jun 30 10:50:23.497159 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Roles: member,reader Jun 30 10:50:23.498759 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/848d69e5041341488aafc3e6d26d491c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_848d69e5041341488aafc3e6d26d491c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/848d69e5041341488aafc3e6d26d491c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/848d69e5041341488aafc3e6d26d491c"}]}] Jun 30 10:50:23.498759 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant: tempest-AttachVolumeNegativeTest-1311706498 Jun 30 10:50:23.498759 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant-Id: 848d69e5041341488aafc3e6d26d491c Jun 30 10:50:23.498759 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1311706498 Jun 30 10:50:23.498759 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User: tempest-AttachVolumeNegativeTest-1311706498-project Jun 30 10:50:23.498759 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Domain-Id: default Jun 30 10:50:23.498759 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Domain-Name: Default Jun 30 10:50:23.498759 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Id: d6a194d68415422fbc6ca75a8dbccf22 Jun 30 10:50:23.498759 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Name: tempest-AttachVolumeNegativeTest-1311706498-project Jun 30 10:50:23.498759 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: method: > Jun 30 10:50:23.498759 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: exception: Instance 5729f9ae-3c4d-490a-9501-b4806724de9d could not be found. Jun 30 10:50:23.498759 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: action_args: {'id': '5729f9ae-3c4d-490a-9501-b4806724de9d'} Jun 30 10:50:23.499671 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:50:23.499671 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:50:23.499671 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 10:50:23.499671 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 10:50:23.499671 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 10:50:23.499671 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 10:50:23.499671 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 10:50:23.499671 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 10:50:23.499671 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 10:50:23.499671 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 10:50:23.499671 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5729f9ae-3c4d-490a-9501-b4806724de9d could not be found. Jun 30 10:50:23.499671 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:50:23.499671 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:50:23.499671 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:50:23.499671 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:50:23.499671 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:50:23.499671 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:50:23.499671 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:50:23.499671 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:50:23.499671 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:50:23.501203 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:50:23.501203 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 10:50:23.501203 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 10:50:23.501203 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 10:50:23.501203 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 10:50:23.501203 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 10:50:23.501203 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:50:23.501203 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5729f9ae-3c4d-490a-9501-b4806724de9d could not be found. Jun 30 10:50:23.501203 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:50:23.501203 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:50:23.501203 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:50:23.501203 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:50:23.501203 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:50:23.501203 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:50:23.501203 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:50:23.501203 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:50:23.501203 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5729f9ae-3c4d-490a-9501-b4806724de9d could not be found. Jun 30 10:50:23.501203 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:50:23.502614 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-547f9306-ecb5-4024-91aa-b3080d41df10 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Returning 404 to user: Instance 5729f9ae-3c4d-490a-9501-b4806724de9d could not be found. {{(pid=124204) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:50:23.502614 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-547f9306-ecb5-4024-91aa-b3080d41df10 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/5729f9ae-3c4d-490a-9501-b4806724de9d" status: 404 len: 111 microversion: 2.1 time: 0.183347 Jun 30 10:50:23.502614 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 487/977] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:50:23 2022] GET /compute/v2.1/servers/5729f9ae-3c4d-490a-9501-b4806724de9d => generated 111 bytes in 184 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 10:50:23.517063 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-ce8caa02-e97f-4c51-bdb9-eb1abddaf7cc tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '.version_select at 0x7f4db25bdca0>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:23.549806 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-ce8caa02-e97f-4c51-bdb9-eb1abddaf7cc tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1657334136" status: 202 len: 0 microversion: 2.1 time: 0.045731 Jun 30 10:50:23.557303 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 491/978] 10.222.0.59 () {58 vars in 1220 bytes} [Thu Jun 30 10:50:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1657334136 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 10:50:23.773094 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-110c7a98-c169-4517-94f1-fe4ff1c931f8 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:23.775197 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-110c7a98-c169-4517-94f1-fe4ff1c931f8 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:23.783602 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-110c7a98-c169-4517-94f1-fe4ff1c931f8 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:23.784205 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-110c7a98-c169-4517-94f1-fe4ff1c931f8 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:23.785172 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-110c7a98-c169-4517-94f1-fe4ff1c931f8 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:23.785740 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-110c7a98-c169-4517-94f1-fe4ff1c931f8 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:23.965545 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-110c7a98-c169-4517-94f1-fe4ff1c931f8 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:23.977008 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-110c7a98-c169-4517-94f1-fe4ff1c931f8 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:23.978761 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-110c7a98-c169-4517-94f1-fe4ff1c931f8 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:23.980195 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-110c7a98-c169-4517-94f1-fe4ff1c931f8 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224" status: 200 len: 1728 microversion: 2.20 time: 0.212837 Jun 30 10:50:23.980940 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 488/979] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:50:23 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 => generated 1728 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:50:23.998077 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-601571f4-6e69-48a8-862d-c42458a7d220 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:23.999445 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-601571f4-6e69-48a8-862d-c42458a7d220 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] [instance: 6526331b-07d9-4ae7-8429-187bf752923d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:24.007162 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-601571f4-6e69-48a8-862d-c42458a7d220 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:24.007927 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-601571f4-6e69-48a8-862d-c42458a7d220 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:24.009082 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-601571f4-6e69-48a8-862d-c42458a7d220 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:24.009774 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-601571f4-6e69-48a8-862d-c42458a7d220 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:24.212225 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-601571f4-6e69-48a8-862d-c42458a7d220 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a24491b2e4545e289fa4f1cff4f30d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ab649bf434f78b83122111ec19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:24.220251 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-601571f4-6e69-48a8-862d-c42458a7d220 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] 10.222.0.59 "GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d" status: 200 len: 1548 microversion: 2.1 time: 0.226696 Jun 30 10:50:24.220869 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 492/980] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:50:23 2022] GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d => generated 1548 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:50:24.237024 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-3b1407ad-bcd5-4fee-86e9-edd032d53a41 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:24.237630 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-3b1407ad-bcd5-4fee-86e9-edd032d53a41 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] [instance: 6526331b-07d9-4ae7-8429-187bf752923d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:24.244291 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-3b1407ad-bcd5-4fee-86e9-edd032d53a41 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:24.244757 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-3b1407ad-bcd5-4fee-86e9-edd032d53a41 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:24.245520 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-3b1407ad-bcd5-4fee-86e9-edd032d53a41 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:24.245947 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-3b1407ad-bcd5-4fee-86e9-edd032d53a41 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:24.250029 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:50:24.434645 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-2333dd06-94a1-4e37-afab-662add54c6c1 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Action: 'create', calling method: .version_select at 0x7f4db2648820>, body: {"keypair": {"name": "tempest-keypair-1940803245", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCQ7Ls3fLaGZR+whxGEdA8Eqgtuvk4P5OiF/e67IXIR4u4gHih0Q6cszXPQ4r6O618blHLhFbBaWLpt3F1bjHeJJ0RSiQtlMfj+qzYmOWZIWrL+iyGZpI3cYz2rHCRm2w=="}} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:50:24.451468 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.quota [None req-2333dd06-94a1-4e37-afab-662add54c6c1 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Getting quotas for project 848d69e5041341488aafc3e6d26d491c. Resources: {'key_pairs'} {{(pid=124203) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 10:50:24.456118 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.quota [None req-2333dd06-94a1-4e37-afab-662add54c6c1 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Getting quotas for user d6a194d68415422fbc6ca75a8dbccf22 and project 848d69e5041341488aafc3e6d26d491c. Resources: {'key_pairs'} {{(pid=124203) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 10:50:24.463993 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-3b1407ad-bcd5-4fee-86e9-edd032d53a41 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a24491b2e4545e289fa4f1cff4f30d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ab649bf434f78b83122111ec19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:24.473628 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-3b1407ad-bcd5-4fee-86e9-edd032d53a41 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] 10.222.0.59 "GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d" status: 200 len: 1548 microversion: 2.1 time: 0.240752 Jun 30 10:50:24.474360 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 489/981] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:50:24 2022] GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d => generated 1548 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:50:24.493556 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-5ee2d72a-50a2-401d-ad87-7a240b39dd7d tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:24.494651 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-2333dd06-94a1-4e37-afab-662add54c6c1 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.064218 Jun 30 10:50:24.495440 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 493/982] 10.222.0.59 () {60 vars in 1158 bytes} [Thu Jun 30 10:50:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:50:24.497436 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-5ee2d72a-50a2-401d-ad87-7a240b39dd7d tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9a24491b2e4545e289fa4f1cff4f30d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ab649bf434f78b83122111ec19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:24.498524 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-5ee2d72a-50a2-401d-ad87-7a240b39dd7d tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Searching by: {'deleted': False, 'project_id': '9d4ab649bf434f78b83122111ec19083'} {{(pid=124204) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 30 10:50:24.506120 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5ee2d72a-50a2-401d-ad87-7a240b39dd7d tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:24.506615 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5ee2d72a-50a2-401d-ad87-7a240b39dd7d tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:24.507499 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5ee2d72a-50a2-401d-ad87-7a240b39dd7d tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:24.508027 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5ee2d72a-50a2-401d-ad87-7a240b39dd7d tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:24.611114 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.multi_cell_list [None req-5ee2d72a-50a2-401d-ad87-7a240b39dd7d tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124204) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 30 10:50:24.712139 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-5ee2d72a-50a2-401d-ad87-7a240b39dd7d tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] 10.222.0.59 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.224237 Jun 30 10:50:24.719243 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 490/983] 10.222.0.59 () {58 vars in 1124 bytes} [Thu Jun 30 10:50:24 2022] GET /compute/v2.1/servers => generated 343 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:50:24.724376 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-bc3884e9-c93e-4a02-ad29-01268fd34524 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:24.726132 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-bc3884e9-c93e-4a02-ad29-01268fd34524 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] [instance: 6526331b-07d9-4ae7-8429-187bf752923d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:24.732378 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-bc3884e9-c93e-4a02-ad29-01268fd34524 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:24.733114 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-bc3884e9-c93e-4a02-ad29-01268fd34524 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:24.734233 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-bc3884e9-c93e-4a02-ad29-01268fd34524 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:24.734831 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-bc3884e9-c93e-4a02-ad29-01268fd34524 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:24.937504 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-bc3884e9-c93e-4a02-ad29-01268fd34524 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a24491b2e4545e289fa4f1cff4f30d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ab649bf434f78b83122111ec19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:24.952381 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-bc3884e9-c93e-4a02-ad29-01268fd34524 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] 10.222.0.59 "GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d" status: 200 len: 1548 microversion: 2.1 time: 0.232894 Jun 30 10:50:24.961356 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 494/984] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:50:24 2022] GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d => generated 1548 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:50:25.000540 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-8d348840-aecf-4a5a-93ce-1070cd7cc964 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:25.001741 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-8d348840-aecf-4a5a-93ce-1070cd7cc964 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:25.016725 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-8d348840-aecf-4a5a-93ce-1070cd7cc964 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:25.018238 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-8d348840-aecf-4a5a-93ce-1070cd7cc964 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:25.021976 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-8d348840-aecf-4a5a-93ce-1070cd7cc964 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:25.027662 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-8d348840-aecf-4a5a-93ce-1070cd7cc964 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:25.272799 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-8d348840-aecf-4a5a-93ce-1070cd7cc964 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:25.284212 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-8d348840-aecf-4a5a-93ce-1070cd7cc964 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:25.286174 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-8d348840-aecf-4a5a-93ce-1070cd7cc964 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:25.287993 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-8d348840-aecf-4a5a-93ce-1070cd7cc964 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224" status: 200 len: 1728 microversion: 2.20 time: 0.292525 Jun 30 10:50:25.301263 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 491/985] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:50:24 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 => generated 1728 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:50:26.155224 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-3c9f6765-4737-469d-822e-2cdd605ec249 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1159873921", "imageRef": "c473bd04-5a45-4eb7-b6f4-2b5033d4fc1d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e1b0416a-2d8f-4305-a932-70d38f831d37"}], "security_groups": [{"name": "tempest-securitygroup--905232196"}], "key_name": "tempest-keypair-1940803245", "user_data": "}} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:50:26.272359 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.network.neutron [None req-3c9f6765-4737-469d-822e-2cdd605ec249 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] validate_networks() for [('e1b0416a-2d8f-4305-a932-70d38f831d37', None, None, None, None, None)] {{(pid=124203) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 10:50:26.308529 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-b0f42e74-246f-4486-b3a0-277d6ed22936 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:26.309933 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-b0f42e74-246f-4486-b3a0-277d6ed22936 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:26.317372 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-b0f42e74-246f-4486-b3a0-277d6ed22936 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:26.318212 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-b0f42e74-246f-4486-b3a0-277d6ed22936 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:26.320013 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-b0f42e74-246f-4486-b3a0-277d6ed22936 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:26.324131 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-b0f42e74-246f-4486-b3a0-277d6ed22936 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:26.531899 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-b0f42e74-246f-4486-b3a0-277d6ed22936 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:26.545922 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-b0f42e74-246f-4486-b3a0-277d6ed22936 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:26.549535 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-b0f42e74-246f-4486-b3a0-277d6ed22936 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:26.554252 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-b0f42e74-246f-4486-b3a0-277d6ed22936 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224" status: 200 len: 1728 microversion: 2.20 time: 0.247700 Jun 30 10:50:26.554825 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 492/986] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:50:26 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 => generated 1728 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 10:50:26.702100 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-0a907539-3839-4469-8ade-7866848a2633 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "08a163bb-1bb2-48c5-8e6f-adc6d4f8ca05"}} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:50:26.705295 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-0a907539-3839-4469-8ade-7866848a2633 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] [instance: 6526331b-07d9-4ae7-8429-187bf752923d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:26.720758 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-0a907539-3839-4469-8ade-7866848a2633 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:26.721207 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-0a907539-3839-4469-8ade-7866848a2633 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:26.722008 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-0a907539-3839-4469-8ade-7866848a2633 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:26.722445 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-0a907539-3839-4469-8ade-7866848a2633 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:26.797015 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.virt.hardware [None req-3c9f6765-4737-469d-822e-2cdd605ec249 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Flavor limits 0:0:0 {{(pid=124203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 10:50:26.797518 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.virt.hardware [None req-3c9f6765-4737-469d-822e-2cdd605ec249 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Image limits 0:0:0 {{(pid=124203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 10:50:26.798100 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.virt.hardware [None req-3c9f6765-4737-469d-822e-2cdd605ec249 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Flavor pref 0:0:0 {{(pid=124203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 10:50:26.798728 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.virt.hardware [None req-3c9f6765-4737-469d-822e-2cdd605ec249 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Image pref 0:0:0 {{(pid=124203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 10:50:26.799476 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.virt.hardware [None req-3c9f6765-4737-469d-822e-2cdd605ec249 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 10:50:26.829859 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-3c9f6765-4737-469d-822e-2cdd605ec249 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:26.830760 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-3c9f6765-4737-469d-822e-2cdd605ec249 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:26.832070 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-3c9f6765-4737-469d-822e-2cdd605ec249 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:26.833198 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-3c9f6765-4737-469d-822e-2cdd605ec249 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:26.869714 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.quota [None req-3c9f6765-4737-469d-822e-2cdd605ec249 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Getting quotas for project 848d69e5041341488aafc3e6d26d491c. Resources: {'instances', 'cores', 'ram'} {{(pid=124203) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 10:50:26.874237 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.quota [None req-3c9f6765-4737-469d-822e-2cdd605ec249 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Getting quotas for user d6a194d68415422fbc6ca75a8dbccf22 and project 848d69e5041341488aafc3e6d26d491c. Resources: {'instances', 'cores', 'ram'} {{(pid=124203) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 10:50:26.889877 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-3c9f6765-4737-469d-822e-2cdd605ec249 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Going to run 1 instances... {{(pid=124203) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 10:50:26.892278 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-3c9f6765-4737-469d-822e-2cdd605ec249 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 71a25d37-33ee-4e2f-a2b3-474b211268c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c473bd04-5a45-4eb7-b6f4-2b5033d4fc1d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124203) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 10:50:26.942122 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-3c9f6765-4737-469d-822e-2cdd605ec249 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.792334 Jun 30 10:50:26.943385 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 495/987] 10.222.0.59 () {60 vars in 1146 bytes} [Thu Jun 30 10:50:26 2022] POST /compute/v2.1/servers => generated 401 bytes in 794 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 30 10:50:26.953485 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-9d618658-d9df-4c0f-a20b-97e2ba1a310f tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:26.954185 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-9d618658-d9df-4c0f-a20b-97e2ba1a310f tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 71a25d37-33ee-4e2f-a2b3-474b211268c4] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:26.956264 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:50:27.025030 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-9d618658-d9df-4c0f-a20b-97e2ba1a310f tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:27.034622 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-9d618658-d9df-4c0f-a20b-97e2ba1a310f tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/71a25d37-33ee-4e2f-a2b3-474b211268c4" status: 200 len: 1242 microversion: 2.1 time: 0.085130 Jun 30 10:50:27.035381 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 496/988] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:50:26 2022] GET /compute/v2.1/servers/71a25d37-33ee-4e2f-a2b3-474b211268c4 => generated 1242 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:50:27.574449 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-3c8b92ba-30c7-454c-9c6f-3077276b735d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:27.575127 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-3c8b92ba-30c7-454c-9c6f-3077276b735d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:27.581556 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-3c8b92ba-30c7-454c-9c6f-3077276b735d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:27.582004 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-3c8b92ba-30c7-454c-9c6f-3077276b735d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:27.582770 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-3c8b92ba-30c7-454c-9c6f-3077276b735d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:27.583396 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-3c8b92ba-30c7-454c-9c6f-3077276b735d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:27.719597 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-3c8b92ba-30c7-454c-9c6f-3077276b735d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:27.728097 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-3c8b92ba-30c7-454c-9c6f-3077276b735d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:27.729724 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-3c8b92ba-30c7-454c-9c6f-3077276b735d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:27.730974 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-3c8b92ba-30c7-454c-9c6f-3077276b735d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224" status: 200 len: 1728 microversion: 2.20 time: 0.160562 Jun 30 10:50:27.741821 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 497/989] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:50:27 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 10:50:28.052142 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-59c9d678-fa9c-45bb-9022-681734fabbe0 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:28.053392 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-59c9d678-fa9c-45bb-9022-681734fabbe0 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 71a25d37-33ee-4e2f-a2b3-474b211268c4] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:28.059475 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-59c9d678-fa9c-45bb-9022-681734fabbe0 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:28.059919 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-59c9d678-fa9c-45bb-9022-681734fabbe0 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:28.060731 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-59c9d678-fa9c-45bb-9022-681734fabbe0 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:28.061169 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-59c9d678-fa9c-45bb-9022-681734fabbe0 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:28.076847 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:50:28.127203 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-59c9d678-fa9c-45bb-9022-681734fabbe0 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:28.137032 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-59c9d678-fa9c-45bb-9022-681734fabbe0 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/71a25d37-33ee-4e2f-a2b3-474b211268c4" status: 200 len: 1246 microversion: 2.1 time: 0.088773 Jun 30 10:50:28.137878 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 498/990] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:50:28 2022] GET /compute/v2.1/servers/71a25d37-33ee-4e2f-a2b3-474b211268c4 => generated 1246 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:50:28.749534 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-29f250bb-8b44-4601-869e-1687d70347c5 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:28.750337 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-29f250bb-8b44-4601-869e-1687d70347c5 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:28.756762 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-29f250bb-8b44-4601-869e-1687d70347c5 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:28.757207 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-29f250bb-8b44-4601-869e-1687d70347c5 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:28.757965 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-29f250bb-8b44-4601-869e-1687d70347c5 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:28.758397 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-29f250bb-8b44-4601-869e-1687d70347c5 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:29.050071 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-29f250bb-8b44-4601-869e-1687d70347c5 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:29.058400 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-29f250bb-8b44-4601-869e-1687d70347c5 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:29.059873 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-29f250bb-8b44-4601-869e-1687d70347c5 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:29.061068 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-29f250bb-8b44-4601-869e-1687d70347c5 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224" status: 200 len: 1728 microversion: 2.20 time: 0.315484 Jun 30 10:50:29.061613 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 499/991] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:50:28 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 => generated 1728 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 10:50:29.154857 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-dbad4b25-9d17-4f61-b55d-b34f1f5d4f3b tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:29.155691 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-dbad4b25-9d17-4f61-b55d-b34f1f5d4f3b tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 71a25d37-33ee-4e2f-a2b3-474b211268c4] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:29.161914 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-dbad4b25-9d17-4f61-b55d-b34f1f5d4f3b tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:29.162494 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-dbad4b25-9d17-4f61-b55d-b34f1f5d4f3b tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:29.163403 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-dbad4b25-9d17-4f61-b55d-b34f1f5d4f3b tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:29.163880 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-dbad4b25-9d17-4f61-b55d-b34f1f5d4f3b tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:29.225727 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-dbad4b25-9d17-4f61-b55d-b34f1f5d4f3b tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:29.234494 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-dbad4b25-9d17-4f61-b55d-b34f1f5d4f3b tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/71a25d37-33ee-4e2f-a2b3-474b211268c4" status: 200 len: 1246 microversion: 2.1 time: 0.084028 Jun 30 10:50:29.235270 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 500/992] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:50:29 2022] GET /compute/v2.1/servers/71a25d37-33ee-4e2f-a2b3-474b211268c4 => generated 1246 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:50:30.079298 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-5e3d5f22-d9f8-4642-afeb-51810dcb71bb tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:30.079999 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-5e3d5f22-d9f8-4642-afeb-51810dcb71bb tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:30.086931 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-5e3d5f22-d9f8-4642-afeb-51810dcb71bb tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:30.087383 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-5e3d5f22-d9f8-4642-afeb-51810dcb71bb tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:30.088156 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-5e3d5f22-d9f8-4642-afeb-51810dcb71bb tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:30.088621 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-5e3d5f22-d9f8-4642-afeb-51810dcb71bb tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:30.225509 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-5e3d5f22-d9f8-4642-afeb-51810dcb71bb tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:30.234325 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-5e3d5f22-d9f8-4642-afeb-51810dcb71bb tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:30.235830 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-5e3d5f22-d9f8-4642-afeb-51810dcb71bb tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:30.237043 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-5e3d5f22-d9f8-4642-afeb-51810dcb71bb tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224" status: 200 len: 1728 microversion: 2.20 time: 0.161767 Jun 30 10:50:30.237598 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 501/993] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:50:30 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 => generated 1728 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 10:50:30.252753 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-6b26daca-59d2-4679-87e4-96dc35bba4d6 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:30.253836 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-6b26daca-59d2-4679-87e4-96dc35bba4d6 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 71a25d37-33ee-4e2f-a2b3-474b211268c4] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:30.260961 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-6b26daca-59d2-4679-87e4-96dc35bba4d6 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:30.261501 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-6b26daca-59d2-4679-87e4-96dc35bba4d6 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:30.262475 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-6b26daca-59d2-4679-87e4-96dc35bba4d6 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:30.262917 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-6b26daca-59d2-4679-87e4-96dc35bba4d6 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:30.325823 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-6b26daca-59d2-4679-87e4-96dc35bba4d6 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:30.333916 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-6b26daca-59d2-4679-87e4-96dc35bba4d6 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/71a25d37-33ee-4e2f-a2b3-474b211268c4" status: 200 len: 1246 microversion: 2.1 time: 0.084925 Jun 30 10:50:30.334956 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 502/994] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:50:30 2022] GET /compute/v2.1/servers/71a25d37-33ee-4e2f-a2b3-474b211268c4 => generated 1246 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:50:31.256980 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-25d5e0d3-b706-4948-a7a7-bd80127b1dc0 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:31.257751 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-25d5e0d3-b706-4948-a7a7-bd80127b1dc0 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:31.264715 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-25d5e0d3-b706-4948-a7a7-bd80127b1dc0 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:31.265272 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-25d5e0d3-b706-4948-a7a7-bd80127b1dc0 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:31.266128 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-25d5e0d3-b706-4948-a7a7-bd80127b1dc0 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:31.266822 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-25d5e0d3-b706-4948-a7a7-bd80127b1dc0 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:31.400103 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-25d5e0d3-b706-4948-a7a7-bd80127b1dc0 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:31.408252 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-25d5e0d3-b706-4948-a7a7-bd80127b1dc0 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:31.409800 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-25d5e0d3-b706-4948-a7a7-bd80127b1dc0 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:31.410978 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-25d5e0d3-b706-4948-a7a7-bd80127b1dc0 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224" status: 200 len: 1728 microversion: 2.20 time: 0.159630 Jun 30 10:50:31.411527 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 503/995] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:50:31 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 10:50:31.415976 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-9473f0d4-2233-49e2-8d54-363cb59ada58 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:31.416614 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-9473f0d4-2233-49e2-8d54-363cb59ada58 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 71a25d37-33ee-4e2f-a2b3-474b211268c4] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:31.422864 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-9473f0d4-2233-49e2-8d54-363cb59ada58 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:31.423326 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-9473f0d4-2233-49e2-8d54-363cb59ada58 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:31.424104 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-9473f0d4-2233-49e2-8d54-363cb59ada58 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:31.424573 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-9473f0d4-2233-49e2-8d54-363cb59ada58 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:31.486756 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-9473f0d4-2233-49e2-8d54-363cb59ada58 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:31.494234 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-9473f0d4-2233-49e2-8d54-363cb59ada58 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/71a25d37-33ee-4e2f-a2b3-474b211268c4" status: 200 len: 1246 microversion: 2.1 time: 0.081731 Jun 30 10:50:31.494801 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 504/996] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:50:31 2022] GET /compute/v2.1/servers/71a25d37-33ee-4e2f-a2b3-474b211268c4 => generated 1246 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:50:32.429524 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-f05d0dad-af76-403d-b4ea-780f094fc6e7 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:32.430898 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-f05d0dad-af76-403d-b4ea-780f094fc6e7 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:32.437551 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-f05d0dad-af76-403d-b4ea-780f094fc6e7 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:32.438006 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-f05d0dad-af76-403d-b4ea-780f094fc6e7 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:32.438779 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-f05d0dad-af76-403d-b4ea-780f094fc6e7 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:32.439205 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-f05d0dad-af76-403d-b4ea-780f094fc6e7 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:32.573622 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-f05d0dad-af76-403d-b4ea-780f094fc6e7 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:32.581857 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-f05d0dad-af76-403d-b4ea-780f094fc6e7 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:32.583665 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-f05d0dad-af76-403d-b4ea-780f094fc6e7 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:32.585348 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-f05d0dad-af76-403d-b4ea-780f094fc6e7 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224" status: 200 len: 1728 microversion: 2.20 time: 0.159799 Jun 30 10:50:32.585896 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 505/997] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:50:32 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 10:50:32.590435 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-33d18182-a73e-430a-a585-3538e8828869 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:32.591024 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-33d18182-a73e-430a-a585-3538e8828869 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 71a25d37-33ee-4e2f-a2b3-474b211268c4] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:32.597289 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-33d18182-a73e-430a-a585-3538e8828869 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:32.597737 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-33d18182-a73e-430a-a585-3538e8828869 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:32.598501 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-33d18182-a73e-430a-a585-3538e8828869 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:32.598938 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-33d18182-a73e-430a-a585-3538e8828869 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:32.661291 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-33d18182-a73e-430a-a585-3538e8828869 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:32.668764 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-33d18182-a73e-430a-a585-3538e8828869 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/71a25d37-33ee-4e2f-a2b3-474b211268c4" status: 200 len: 1246 microversion: 2.1 time: 0.081892 Jun 30 10:50:32.669318 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 506/998] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:50:32 2022] GET /compute/v2.1/servers/71a25d37-33ee-4e2f-a2b3-474b211268c4 => generated 1246 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:50:33.605641 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-5c2c906f-eb15-4386-a0d2-6694c40d46f9 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:33.606282 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-5c2c906f-eb15-4386-a0d2-6694c40d46f9 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:33.613202 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-5c2c906f-eb15-4386-a0d2-6694c40d46f9 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:33.613643 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-5c2c906f-eb15-4386-a0d2-6694c40d46f9 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:33.614395 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-5c2c906f-eb15-4386-a0d2-6694c40d46f9 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:33.614826 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-5c2c906f-eb15-4386-a0d2-6694c40d46f9 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:33.743177 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-5c2c906f-eb15-4386-a0d2-6694c40d46f9 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:33.750977 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-5c2c906f-eb15-4386-a0d2-6694c40d46f9 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:33.752457 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-5c2c906f-eb15-4386-a0d2-6694c40d46f9 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:33.753622 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-5c2c906f-eb15-4386-a0d2-6694c40d46f9 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224" status: 200 len: 1728 microversion: 2.20 time: 0.151919 Jun 30 10:50:33.754162 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 507/999] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:50:33 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 10:50:33.758480 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-79eb241c-9933-4cc5-9ce1-9b7d98ef42ae tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:33.759068 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-79eb241c-9933-4cc5-9ce1-9b7d98ef42ae tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 71a25d37-33ee-4e2f-a2b3-474b211268c4] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:33.764556 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-79eb241c-9933-4cc5-9ce1-9b7d98ef42ae tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:33.764956 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-79eb241c-9933-4cc5-9ce1-9b7d98ef42ae tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:33.765705 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-79eb241c-9933-4cc5-9ce1-9b7d98ef42ae tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:33.766136 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-79eb241c-9933-4cc5-9ce1-9b7d98ef42ae tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:33.824266 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-79eb241c-9933-4cc5-9ce1-9b7d98ef42ae tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:33.831424 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-79eb241c-9933-4cc5-9ce1-9b7d98ef42ae tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/71a25d37-33ee-4e2f-a2b3-474b211268c4" status: 200 len: 1246 microversion: 2.1 time: 0.076343 Jun 30 10:50:33.831976 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 508/1000] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:50:33 2022] GET /compute/v2.1/servers/71a25d37-33ee-4e2f-a2b3-474b211268c4 => generated 1246 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:50:34.560581 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_cell0:SELECT=2 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:50:34.771418 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-21c78c8c-d9fb-4e87-aad7-56773dd71f33 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:34.772022 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-21c78c8c-d9fb-4e87-aad7-56773dd71f33 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:34.778537 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-21c78c8c-d9fb-4e87-aad7-56773dd71f33 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:34.778982 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-21c78c8c-d9fb-4e87-aad7-56773dd71f33 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:34.779732 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-21c78c8c-d9fb-4e87-aad7-56773dd71f33 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:34.780164 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-21c78c8c-d9fb-4e87-aad7-56773dd71f33 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:34.905499 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-21c78c8c-d9fb-4e87-aad7-56773dd71f33 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:34.914571 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-21c78c8c-d9fb-4e87-aad7-56773dd71f33 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:34.916222 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-21c78c8c-d9fb-4e87-aad7-56773dd71f33 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:34.917445 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-21c78c8c-d9fb-4e87-aad7-56773dd71f33 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224" status: 200 len: 1728 microversion: 2.20 time: 0.149848 Jun 30 10:50:34.917999 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 509/1001] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:50:34 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 10:50:34.922511 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-aee7e3ee-6fc8-4c9a-ab81-504e99c0aa78 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:34.923117 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-aee7e3ee-6fc8-4c9a-ab81-504e99c0aa78 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 71a25d37-33ee-4e2f-a2b3-474b211268c4] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:34.928994 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-aee7e3ee-6fc8-4c9a-ab81-504e99c0aa78 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:34.930064 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-aee7e3ee-6fc8-4c9a-ab81-504e99c0aa78 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:34.930825 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-aee7e3ee-6fc8-4c9a-ab81-504e99c0aa78 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:34.931261 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-aee7e3ee-6fc8-4c9a-ab81-504e99c0aa78 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:34.991315 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-aee7e3ee-6fc8-4c9a-ab81-504e99c0aa78 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:34.999428 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-aee7e3ee-6fc8-4c9a-ab81-504e99c0aa78 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/71a25d37-33ee-4e2f-a2b3-474b211268c4" status: 200 len: 1246 microversion: 2.1 time: 0.080498 Jun 30 10:50:34.999980 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 510/1002] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:50:34 2022] GET /compute/v2.1/servers/71a25d37-33ee-4e2f-a2b3-474b211268c4 => generated 1246 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:50:35.935106 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-814eec53-10bb-4df1-b5fb-4ec1937ee899 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:35.935752 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-814eec53-10bb-4df1-b5fb-4ec1937ee899 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:35.942173 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-814eec53-10bb-4df1-b5fb-4ec1937ee899 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:35.942628 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-814eec53-10bb-4df1-b5fb-4ec1937ee899 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:35.943390 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-814eec53-10bb-4df1-b5fb-4ec1937ee899 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:35.943831 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-814eec53-10bb-4df1-b5fb-4ec1937ee899 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:36.075740 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-814eec53-10bb-4df1-b5fb-4ec1937ee899 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:36.083627 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-814eec53-10bb-4df1-b5fb-4ec1937ee899 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:36.085155 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-814eec53-10bb-4df1-b5fb-4ec1937ee899 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:36.086324 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-814eec53-10bb-4df1-b5fb-4ec1937ee899 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224" status: 200 len: 1728 microversion: 2.20 time: 0.155106 Jun 30 10:50:36.086919 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 511/1003] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:50:35 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 10:50:36.091246 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-7b8dce89-6597-40c5-a7b8-d7bec3c27a9f tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:36.091859 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-7b8dce89-6597-40c5-a7b8-d7bec3c27a9f tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 71a25d37-33ee-4e2f-a2b3-474b211268c4] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:36.097977 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-7b8dce89-6597-40c5-a7b8-d7bec3c27a9f tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:36.098433 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-7b8dce89-6597-40c5-a7b8-d7bec3c27a9f tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:36.099202 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-7b8dce89-6597-40c5-a7b8-d7bec3c27a9f tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:36.099643 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-7b8dce89-6597-40c5-a7b8-d7bec3c27a9f tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:36.160084 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-7b8dce89-6597-40c5-a7b8-d7bec3c27a9f tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:36.167377 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-7b8dce89-6597-40c5-a7b8-d7bec3c27a9f tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/71a25d37-33ee-4e2f-a2b3-474b211268c4" status: 200 len: 1238 microversion: 2.1 time: 0.079557 Jun 30 10:50:36.167944 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 512/1004] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:50:36 2022] GET /compute/v2.1/servers/71a25d37-33ee-4e2f-a2b3-474b211268c4 => generated 1238 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:50:36.717740 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_api:SELECT=69 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:50:36.806572 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_cell1:SELECT=30 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:50:37.107417 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-80407104-6f7c-4435-9b8f-18b35bdf0179 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:37.108329 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-80407104-6f7c-4435-9b8f-18b35bdf0179 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:37.110183 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_cell0:SELECT=2 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:50:37.111357 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_cell0:SELECT=12 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:50:37.117164 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-80407104-6f7c-4435-9b8f-18b35bdf0179 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:37.117607 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-80407104-6f7c-4435-9b8f-18b35bdf0179 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:37.118364 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-80407104-6f7c-4435-9b8f-18b35bdf0179 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:37.118797 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-80407104-6f7c-4435-9b8f-18b35bdf0179 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:37.251601 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-80407104-6f7c-4435-9b8f-18b35bdf0179 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:37.260053 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-80407104-6f7c-4435-9b8f-18b35bdf0179 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:37.261523 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-80407104-6f7c-4435-9b8f-18b35bdf0179 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:37.262672 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-80407104-6f7c-4435-9b8f-18b35bdf0179 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224" status: 200 len: 1728 microversion: 2.20 time: 0.159328 Jun 30 10:50:37.263219 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 513/1005] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:50:37 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 10:50:37.267603 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-4419590f-7500-456b-9be4-a127aaaa2bf1 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:37.268197 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-4419590f-7500-456b-9be4-a127aaaa2bf1 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 71a25d37-33ee-4e2f-a2b3-474b211268c4] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:37.274825 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-4419590f-7500-456b-9be4-a127aaaa2bf1 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:37.275048 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-4419590f-7500-456b-9be4-a127aaaa2bf1 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:37.275811 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-4419590f-7500-456b-9be4-a127aaaa2bf1 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:37.276324 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-4419590f-7500-456b-9be4-a127aaaa2bf1 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:37.336160 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-4419590f-7500-456b-9be4-a127aaaa2bf1 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:37.345508 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-4419590f-7500-456b-9be4-a127aaaa2bf1 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/71a25d37-33ee-4e2f-a2b3-474b211268c4" status: 200 len: 1238 microversion: 2.1 time: 0.081345 Jun 30 10:50:37.346061 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 514/1006] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:50:37 2022] GET /compute/v2.1/servers/71a25d37-33ee-4e2f-a2b3-474b211268c4 => generated 1238 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:50:37.911399 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-0a907539-3839-4469-8ade-7866848a2633 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] 10.222.0.59 "POST /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 11.213271 Jun 30 10:50:37.912381 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 493/1007] 10.222.0.59 () {60 vars in 1322 bytes} [Thu Jun 30 10:50:26 2022] POST /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d/os-volume_attachments => generated 194 bytes in 11215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:50:38.280746 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-bf0fa257-3c0a-4bcf-b9d0-a697d3f5c788 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:38.281461 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-bf0fa257-3c0a-4bcf-b9d0-a697d3f5c788 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:38.288937 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-bf0fa257-3c0a-4bcf-b9d0-a697d3f5c788 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:38.290014 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-bf0fa257-3c0a-4bcf-b9d0-a697d3f5c788 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:38.291018 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-bf0fa257-3c0a-4bcf-b9d0-a697d3f5c788 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:38.291675 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-bf0fa257-3c0a-4bcf-b9d0-a697d3f5c788 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:38.294768 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_cell1:SELECT=100 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:50:38.363574 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-a3aaa90d-0aee-424b-b77e-8ea2dbee9c01 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:38.364376 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-a3aaa90d-0aee-424b-b77e-8ea2dbee9c01 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 71a25d37-33ee-4e2f-a2b3-474b211268c4] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:38.374351 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a3aaa90d-0aee-424b-b77e-8ea2dbee9c01 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:38.374806 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a3aaa90d-0aee-424b-b77e-8ea2dbee9c01 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:38.375775 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a3aaa90d-0aee-424b-b77e-8ea2dbee9c01 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:38.376189 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a3aaa90d-0aee-424b-b77e-8ea2dbee9c01 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:38.464211 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-a3aaa90d-0aee-424b-b77e-8ea2dbee9c01 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:38.467588 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-bf0fa257-3c0a-4bcf-b9d0-a697d3f5c788 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:38.472400 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-a3aaa90d-0aee-424b-b77e-8ea2dbee9c01 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/71a25d37-33ee-4e2f-a2b3-474b211268c4" status: 200 len: 1300 microversion: 2.1 time: 0.113167 Jun 30 10:50:38.473086 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 494/1008] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:50:38 2022] GET /compute/v2.1/servers/71a25d37-33ee-4e2f-a2b3-474b211268c4 => generated 1300 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:50:38.482746 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-bf0fa257-3c0a-4bcf-b9d0-a697d3f5c788 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:38.482746 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-bf0fa257-3c0a-4bcf-b9d0-a697d3f5c788 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:38.482746 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-bf0fa257-3c0a-4bcf-b9d0-a697d3f5c788 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224" status: 200 len: 1728 microversion: 2.20 time: 0.201429 Jun 30 10:50:38.483366 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 515/1009] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:50:38 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 => generated 1728 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:50:39.491470 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-e35fbe67-778d-4170-afe1-42b9c77338cc tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:39.497931 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-681049f4-ec74-4e91-a13e-e309f40ac273 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:39.498980 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-e35fbe67-778d-4170-afe1-42b9c77338cc tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 71a25d37-33ee-4e2f-a2b3-474b211268c4] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:39.499356 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-681049f4-ec74-4e91-a13e-e309f40ac273 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:39.509145 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-e35fbe67-778d-4170-afe1-42b9c77338cc tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:39.509322 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-681049f4-ec74-4e91-a13e-e309f40ac273 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:39.509597 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-e35fbe67-778d-4170-afe1-42b9c77338cc tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:39.510029 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-681049f4-ec74-4e91-a13e-e309f40ac273 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:39.510383 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-e35fbe67-778d-4170-afe1-42b9c77338cc tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:39.511002 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-681049f4-ec74-4e91-a13e-e309f40ac273 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:39.511516 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-681049f4-ec74-4e91-a13e-e309f40ac273 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:39.511638 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-e35fbe67-778d-4170-afe1-42b9c77338cc tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:39.758592 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-681049f4-ec74-4e91-a13e-e309f40ac273 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:39.762434 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-e35fbe67-778d-4170-afe1-42b9c77338cc tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:39.770791 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-e35fbe67-778d-4170-afe1-42b9c77338cc tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/71a25d37-33ee-4e2f-a2b3-474b211268c4" status: 200 len: 1367 microversion: 2.1 time: 0.283416 Jun 30 10:50:39.771717 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-681049f4-ec74-4e91-a13e-e309f40ac273 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:39.772284 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 495/1010] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:50:39 2022] GET /compute/v2.1/servers/71a25d37-33ee-4e2f-a2b3-474b211268c4 => generated 1367 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:50:39.773812 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-681049f4-ec74-4e91-a13e-e309f40ac273 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:39.775748 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-681049f4-ec74-4e91-a13e-e309f40ac273 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224" status: 200 len: 1728 microversion: 2.20 time: 0.281620 Jun 30 10:50:39.776875 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 516/1011] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:50:39 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 => generated 1728 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:50:39.884917 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [req-d84ca666-4d56-4058-839e-b8b63151ccf3 req-499f8c70-4fed-41ab-918b-19e58a9cda7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71a25d37-33ee-4e2f-a2b3-474b211268c4", "tag": "069370ba-0ec4-4f19-914f-312ecbfdf92b"}]} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:50:39.893779 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-d84ca666-4d56-4058-839e-b8b63151ccf3 req-499f8c70-4fed-41ab-918b-19e58a9cda7e service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:39.894219 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-d84ca666-4d56-4058-839e-b8b63151ccf3 req-499f8c70-4fed-41ab-918b-19e58a9cda7e service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:39.906630 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.compute.server_external_events [req-d84ca666-4d56-4058-839e-b8b63151ccf3 req-499f8c70-4fed-41ab-918b-19e58a9cda7e service nova] Creating event network-changed:069370ba-0ec4-4f19-914f-312ecbfdf92b for instance 71a25d37-33ee-4e2f-a2b3-474b211268c4 on hv-cinder-82282 Jun 30 10:50:39.911892 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [req-d84ca666-4d56-4058-839e-b8b63151ccf3 req-499f8c70-4fed-41ab-918b-19e58a9cda7e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107510 Jun 30 10:50:39.912730 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 496/1012] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:50:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 10:50:40.798627 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-8ab85f83-e3f5-4ebf-96ec-a0b73c08d429 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:40.799170 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-8ab85f83-e3f5-4ebf-96ec-a0b73c08d429 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 71a25d37-33ee-4e2f-a2b3-474b211268c4] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:40.803036 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-d58b13c6-5171-44c0-ae4c-f4bac2d9ce45 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:40.803725 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-d58b13c6-5171-44c0-ae4c-f4bac2d9ce45 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:40.805508 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-8ab85f83-e3f5-4ebf-96ec-a0b73c08d429 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:40.806003 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-8ab85f83-e3f5-4ebf-96ec-a0b73c08d429 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:40.806792 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-8ab85f83-e3f5-4ebf-96ec-a0b73c08d429 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:40.807247 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-8ab85f83-e3f5-4ebf-96ec-a0b73c08d429 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:40.810004 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d58b13c6-5171-44c0-ae4c-f4bac2d9ce45 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:40.810436 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d58b13c6-5171-44c0-ae4c-f4bac2d9ce45 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:40.811186 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d58b13c6-5171-44c0-ae4c-f4bac2d9ce45 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:40.811610 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d58b13c6-5171-44c0-ae4c-f4bac2d9ce45 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:41.004989 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-8ab85f83-e3f5-4ebf-96ec-a0b73c08d429 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:41.011838 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-d58b13c6-5171-44c0-ae4c-f4bac2d9ce45 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:41.013285 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-8ab85f83-e3f5-4ebf-96ec-a0b73c08d429 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/71a25d37-33ee-4e2f-a2b3-474b211268c4" status: 200 len: 1367 microversion: 2.1 time: 0.218624 Jun 30 10:50:41.014611 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 517/1013] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:50:40 2022] GET /compute/v2.1/servers/71a25d37-33ee-4e2f-a2b3-474b211268c4 => generated 1367 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:50:41.020162 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-d58b13c6-5171-44c0-ae4c-f4bac2d9ce45 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:41.021813 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-d58b13c6-5171-44c0-ae4c-f4bac2d9ce45 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:41.022976 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-d58b13c6-5171-44c0-ae4c-f4bac2d9ce45 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224" status: 200 len: 1728 microversion: 2.20 time: 0.224933 Jun 30 10:50:41.023518 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 497/1014] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:50:40 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 => generated 1728 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 10:50:41.103408 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [req-0a8c4fc9-4a7f-410b-8433-3fd08d082165 req-41b368d9-c1d6-41f6-aefa-5f3d94032edd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a6b5e16-473d-4317-8bf7-ee0df07cb224", "name": "network-vif-plugged", "status": "completed", "tag": "616d9e47-3706-4db1-a51a-9e45603ab16c"}]} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:50:41.113586 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-0a8c4fc9-4a7f-410b-8433-3fd08d082165 req-41b368d9-c1d6-41f6-aefa-5f3d94032edd service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:41.114073 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-0a8c4fc9-4a7f-410b-8433-3fd08d082165 req-41b368d9-c1d6-41f6-aefa-5f3d94032edd service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:41.126866 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.compute.server_external_events [req-0a8c4fc9-4a7f-410b-8433-3fd08d082165 req-41b368d9-c1d6-41f6-aefa-5f3d94032edd service nova] Creating event network-vif-plugged:616d9e47-3706-4db1-a51a-9e45603ab16c for instance 7a6b5e16-473d-4317-8bf7-ee0df07cb224 on hv-cinder-82282 Jun 30 10:50:41.132345 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [req-0a8c4fc9-4a7f-410b-8433-3fd08d082165 req-41b368d9-c1d6-41f6-aefa-5f3d94032edd service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032523 Jun 30 10:50:41.133123 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 518/1015] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:50:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:50:42.031092 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-bb2dde2a-b8de-4a40-be12-fed730b95651 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:42.031707 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-bb2dde2a-b8de-4a40-be12-fed730b95651 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 71a25d37-33ee-4e2f-a2b3-474b211268c4] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:42.038304 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-bb2dde2a-b8de-4a40-be12-fed730b95651 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:42.038744 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-bb2dde2a-b8de-4a40-be12-fed730b95651 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:42.039507 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-bb2dde2a-b8de-4a40-be12-fed730b95651 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:42.039943 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-bb2dde2a-b8de-4a40-be12-fed730b95651 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:42.042011 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-d17eb43c-6923-4886-9da3-1dfae89d0642 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:42.042728 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-d17eb43c-6923-4886-9da3-1dfae89d0642 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:42.049477 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-d17eb43c-6923-4886-9da3-1dfae89d0642 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:42.049923 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-d17eb43c-6923-4886-9da3-1dfae89d0642 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:42.050678 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-d17eb43c-6923-4886-9da3-1dfae89d0642 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:42.051110 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-d17eb43c-6923-4886-9da3-1dfae89d0642 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:42.221311 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-bb2dde2a-b8de-4a40-be12-fed730b95651 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:42.238997 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-bb2dde2a-b8de-4a40-be12-fed730b95651 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/71a25d37-33ee-4e2f-a2b3-474b211268c4" status: 200 len: 1367 microversion: 2.1 time: 0.211728 Jun 30 10:50:42.240016 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 498/1016] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:50:42 2022] GET /compute/v2.1/servers/71a25d37-33ee-4e2f-a2b3-474b211268c4 => generated 1367 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:50:42.242388 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-d17eb43c-6923-4886-9da3-1dfae89d0642 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:42.250872 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-d17eb43c-6923-4886-9da3-1dfae89d0642 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:42.252364 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-d17eb43c-6923-4886-9da3-1dfae89d0642 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:42.253577 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-d17eb43c-6923-4886-9da3-1dfae89d0642 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224" status: 200 len: 1728 microversion: 2.20 time: 0.215700 Jun 30 10:50:42.254130 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 519/1017] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:50:42 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 => generated 1728 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 10:50:43.257306 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-a1c4d36f-8849-413a-bae2-225a870b014a tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:43.257910 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-a1c4d36f-8849-413a-bae2-225a870b014a tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 71a25d37-33ee-4e2f-a2b3-474b211268c4] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:43.265468 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a1c4d36f-8849-413a-bae2-225a870b014a tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:43.265911 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a1c4d36f-8849-413a-bae2-225a870b014a tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:43.266678 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a1c4d36f-8849-413a-bae2-225a870b014a tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:43.267141 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a1c4d36f-8849-413a-bae2-225a870b014a tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:43.273334 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-dd0449d8-07a3-4dbe-a687-fe7262e00099 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:43.274009 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-dd0449d8-07a3-4dbe-a687-fe7262e00099 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:43.280934 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-dd0449d8-07a3-4dbe-a687-fe7262e00099 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:43.281410 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-dd0449d8-07a3-4dbe-a687-fe7262e00099 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:43.282232 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-dd0449d8-07a3-4dbe-a687-fe7262e00099 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:43.282674 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-dd0449d8-07a3-4dbe-a687-fe7262e00099 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:43.468676 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-a1c4d36f-8849-413a-bae2-225a870b014a tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:43.472982 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-dd0449d8-07a3-4dbe-a687-fe7262e00099 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:43.476056 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-a1c4d36f-8849-413a-bae2-225a870b014a tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/71a25d37-33ee-4e2f-a2b3-474b211268c4" status: 200 len: 1367 microversion: 2.1 time: 0.222535 Jun 30 10:50:43.476639 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 499/1018] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:50:43 2022] GET /compute/v2.1/servers/71a25d37-33ee-4e2f-a2b3-474b211268c4 => generated 1367 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:50:43.481069 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-dd0449d8-07a3-4dbe-a687-fe7262e00099 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:43.482593 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-dd0449d8-07a3-4dbe-a687-fe7262e00099 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:43.484014 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-dd0449d8-07a3-4dbe-a687-fe7262e00099 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224" status: 200 len: 1728 microversion: 2.20 time: 0.214597 Jun 30 10:50:43.484577 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 520/1019] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:50:43 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 => generated 1728 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 10:50:44.492360 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-2334d149-68bd-4f75-baa8-574d33c94162 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:44.493032 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-2334d149-68bd-4f75-baa8-574d33c94162 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 71a25d37-33ee-4e2f-a2b3-474b211268c4] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:44.499645 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-2334d149-68bd-4f75-baa8-574d33c94162 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:44.500038 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-2334d149-68bd-4f75-baa8-574d33c94162 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:44.500830 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-2334d149-68bd-4f75-baa8-574d33c94162 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:44.501277 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-2334d149-68bd-4f75-baa8-574d33c94162 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:44.502434 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-b35d2a4b-a015-47e2-a98b-2c2be342d65d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:44.503025 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-b35d2a4b-a015-47e2-a98b-2c2be342d65d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:44.509436 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b35d2a4b-a015-47e2-a98b-2c2be342d65d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:44.509888 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b35d2a4b-a015-47e2-a98b-2c2be342d65d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:44.510652 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b35d2a4b-a015-47e2-a98b-2c2be342d65d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:44.511090 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b35d2a4b-a015-47e2-a98b-2c2be342d65d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:44.700247 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-2334d149-68bd-4f75-baa8-574d33c94162 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:44.706929 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-b35d2a4b-a015-47e2-a98b-2c2be342d65d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:44.715201 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-2334d149-68bd-4f75-baa8-574d33c94162 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/71a25d37-33ee-4e2f-a2b3-474b211268c4" status: 200 len: 1367 microversion: 2.1 time: 0.226541 Jun 30 10:50:44.715778 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 500/1020] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:50:44 2022] GET /compute/v2.1/servers/71a25d37-33ee-4e2f-a2b3-474b211268c4 => generated 1367 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:50:44.715922 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-b35d2a4b-a015-47e2-a98b-2c2be342d65d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:44.717511 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-b35d2a4b-a015-47e2-a98b-2c2be342d65d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:44.718676 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-b35d2a4b-a015-47e2-a98b-2c2be342d65d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224" status: 200 len: 1728 microversion: 2.20 time: 0.220186 Jun 30 10:50:44.719455 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 521/1021] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:50:44 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 => generated 1728 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 10:50:45.135212 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [req-57d4ce44-9cd0-45d0-a60b-ad7368d4ec55 req-3442cd11-8171-4341-8702-70cfd710ec97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71a25d37-33ee-4e2f-a2b3-474b211268c4", "name": "network-vif-plugged", "status": "completed", "tag": "069370ba-0ec4-4f19-914f-312ecbfdf92b"}]} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:50:45.144785 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-57d4ce44-9cd0-45d0-a60b-ad7368d4ec55 req-3442cd11-8171-4341-8702-70cfd710ec97 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:45.145471 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-57d4ce44-9cd0-45d0-a60b-ad7368d4ec55 req-3442cd11-8171-4341-8702-70cfd710ec97 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:45.156909 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.compute.server_external_events [req-57d4ce44-9cd0-45d0-a60b-ad7368d4ec55 req-3442cd11-8171-4341-8702-70cfd710ec97 service nova] Creating event network-vif-plugged:069370ba-0ec4-4f19-914f-312ecbfdf92b for instance 71a25d37-33ee-4e2f-a2b3-474b211268c4 on hv-cinder-82282 Jun 30 10:50:45.161665 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [req-57d4ce44-9cd0-45d0-a60b-ad7368d4ec55 req-3442cd11-8171-4341-8702-70cfd710ec97 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031625 Jun 30 10:50:45.162270 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 501/1022] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:50:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:50:45.731477 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-0d1f8c9c-6c97-4d93-9e74-d7685e1e1955 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:45.732250 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-0d1f8c9c-6c97-4d93-9e74-d7685e1e1955 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 71a25d37-33ee-4e2f-a2b3-474b211268c4] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:45.737272 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-8bc44eec-ffff-4c53-9010-867051ac8e82 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:45.737971 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-8bc44eec-ffff-4c53-9010-867051ac8e82 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:45.739787 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0d1f8c9c-6c97-4d93-9e74-d7685e1e1955 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:45.740266 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0d1f8c9c-6c97-4d93-9e74-d7685e1e1955 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:45.741100 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0d1f8c9c-6c97-4d93-9e74-d7685e1e1955 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:45.741558 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0d1f8c9c-6c97-4d93-9e74-d7685e1e1955 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:45.745345 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-8bc44eec-ffff-4c53-9010-867051ac8e82 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:45.745795 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-8bc44eec-ffff-4c53-9010-867051ac8e82 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:45.746781 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-8bc44eec-ffff-4c53-9010-867051ac8e82 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:45.747221 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-8bc44eec-ffff-4c53-9010-867051ac8e82 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:45.928216 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-0d1f8c9c-6c97-4d93-9e74-d7685e1e1955 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:45.935352 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-8bc44eec-ffff-4c53-9010-867051ac8e82 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:45.936358 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-0d1f8c9c-6c97-4d93-9e74-d7685e1e1955 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/71a25d37-33ee-4e2f-a2b3-474b211268c4" status: 200 len: 1367 microversion: 2.1 time: 0.209084 Jun 30 10:50:45.936971 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 522/1023] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:50:45 2022] GET /compute/v2.1/servers/71a25d37-33ee-4e2f-a2b3-474b211268c4 => generated 1367 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:50:45.943506 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-8bc44eec-ffff-4c53-9010-867051ac8e82 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:45.945028 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-8bc44eec-ffff-4c53-9010-867051ac8e82 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:45.946745 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-8bc44eec-ffff-4c53-9010-867051ac8e82 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224" status: 200 len: 1715 microversion: 2.20 time: 0.214032 Jun 30 10:50:45.947288 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 502/1024] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:50:45 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 => generated 1715 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 10:50:46.511375 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-6b5417c2-48e6-4845-ae68-d231b48abd28 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:46.512092 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-6b5417c2-48e6-4845-ae68-d231b48abd28 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] [instance: 6526331b-07d9-4ae7-8429-187bf752923d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:46.518223 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-6b5417c2-48e6-4845-ae68-d231b48abd28 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:46.518668 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-6b5417c2-48e6-4845-ae68-d231b48abd28 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:46.519424 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-6b5417c2-48e6-4845-ae68-d231b48abd28 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:46.519865 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-6b5417c2-48e6-4845-ae68-d231b48abd28 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:46.660736 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-6b5417c2-48e6-4845-ae68-d231b48abd28 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a24491b2e4545e289fa4f1cff4f30d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ab649bf434f78b83122111ec19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:46.669718 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-6b5417c2-48e6-4845-ae68-d231b48abd28 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] 10.222.0.59 "GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d" status: 200 len: 1594 microversion: 2.1 time: 0.162528 Jun 30 10:50:46.670341 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 523/1025] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:50:46 2022] GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d => generated 1594 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:50:46.954376 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-b87b4423-b2bb-41b0-af1f-284f37587544 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:46.954948 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-b87b4423-b2bb-41b0-af1f-284f37587544 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 71a25d37-33ee-4e2f-a2b3-474b211268c4] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:46.962076 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-b87b4423-b2bb-41b0-af1f-284f37587544 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:46.962535 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-b87b4423-b2bb-41b0-af1f-284f37587544 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:46.963337 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-b87b4423-b2bb-41b0-af1f-284f37587544 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:46.963781 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-b87b4423-b2bb-41b0-af1f-284f37587544 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:47.172869 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-b87b4423-b2bb-41b0-af1f-284f37587544 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:47.181217 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-b87b4423-b2bb-41b0-af1f-284f37587544 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/71a25d37-33ee-4e2f-a2b3-474b211268c4" status: 200 len: 1367 microversion: 2.1 time: 0.230782 Jun 30 10:50:47.181824 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 503/1026] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:50:46 2022] GET /compute/v2.1/servers/71a25d37-33ee-4e2f-a2b3-474b211268c4 => generated 1367 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:50:48.198182 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-abdd0888-b133-4963-9583-4c20efcb3691 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:48.198802 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-abdd0888-b133-4963-9583-4c20efcb3691 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 71a25d37-33ee-4e2f-a2b3-474b211268c4] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:48.205574 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-abdd0888-b133-4963-9583-4c20efcb3691 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:48.206026 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-abdd0888-b133-4963-9583-4c20efcb3691 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:48.206803 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-abdd0888-b133-4963-9583-4c20efcb3691 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:48.207244 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-abdd0888-b133-4963-9583-4c20efcb3691 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:48.452166 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-abdd0888-b133-4963-9583-4c20efcb3691 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:48.459694 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-abdd0888-b133-4963-9583-4c20efcb3691 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/71a25d37-33ee-4e2f-a2b3-474b211268c4" status: 200 len: 1558 microversion: 2.1 time: 0.265493 Jun 30 10:50:48.460259 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 524/1027] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:50:48 2022] GET /compute/v2.1/servers/71a25d37-33ee-4e2f-a2b3-474b211268c4 => generated 1558 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:50:48.476866 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-f18cdfd0-7f85-4a15-a861-34c6d58028a3 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:48.477441 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-f18cdfd0-7f85-4a15-a861-34c6d58028a3 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 71a25d37-33ee-4e2f-a2b3-474b211268c4] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:48.484249 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f18cdfd0-7f85-4a15-a861-34c6d58028a3 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:48.484925 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f18cdfd0-7f85-4a15-a861-34c6d58028a3 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:48.485900 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f18cdfd0-7f85-4a15-a861-34c6d58028a3 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:48.486440 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f18cdfd0-7f85-4a15-a861-34c6d58028a3 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:48.632129 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-f18cdfd0-7f85-4a15-a861-34c6d58028a3 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/71a25d37-33ee-4e2f-a2b3-474b211268c4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.159435 Jun 30 10:50:48.632751 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 504/1028] 10.222.0.59 () {58 vars in 1274 bytes} [Thu Jun 30 10:50:48 2022] GET /compute/v2.1/servers/71a25d37-33ee-4e2f-a2b3-474b211268c4/os-interface => generated 285 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:50:48.711985 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [req-446b740b-c0d0-41c9-9776-dc46e2aaeae8 req-da218987-54dc-45bd-869f-ae20cbf3c96c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6526331b-07d9-4ae7-8429-187bf752923d", "tag": "1ba7efd4-5bb9-4ada-b21b-02272e12a627"}]} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:50:48.724014 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-446b740b-c0d0-41c9-9776-dc46e2aaeae8 req-da218987-54dc-45bd-869f-ae20cbf3c96c service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:48.725017 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-446b740b-c0d0-41c9-9776-dc46e2aaeae8 req-da218987-54dc-45bd-869f-ae20cbf3c96c service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:48.742854 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.compute.server_external_events [req-446b740b-c0d0-41c9-9776-dc46e2aaeae8 req-da218987-54dc-45bd-869f-ae20cbf3c96c service nova] Creating event network-changed:1ba7efd4-5bb9-4ada-b21b-02272e12a627 for instance 6526331b-07d9-4ae7-8429-187bf752923d on hv-cinder-82282 Jun 30 10:50:48.748725 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [req-446b740b-c0d0-41c9-9776-dc46e2aaeae8 req-da218987-54dc-45bd-869f-ae20cbf3c96c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043523 Jun 30 10:50:48.749935 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 525/1029] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:50:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:50:49.737295 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-6ac7b27b-2fe6-4977-b536-1ed667b7c467 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2124632173"}} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:50:49.737962 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-6ac7b27b-2fe6-4977-b536-1ed667b7c467 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] [instance: 6526331b-07d9-4ae7-8429-187bf752923d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:49.746873 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6ac7b27b-2fe6-4977-b536-1ed667b7c467 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:49.747446 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6ac7b27b-2fe6-4977-b536-1ed667b7c467 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:49.748479 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6ac7b27b-2fe6-4977-b536-1ed667b7c467 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:49.749164 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6ac7b27b-2fe6-4977-b536-1ed667b7c467 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:49.893325 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.network.security_group_api [None req-6ac7b27b-2fe6-4977-b536-1ed667b7c467 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Adding security group 42d7631c-8307-4dae-aee3-cdaaebe0a7af to port 1ba7efd4-5bb9-4ada-b21b-02272e12a627 Jun 30 10:50:50.276633 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-6ac7b27b-2fe6-4977-b536-1ed667b7c467 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] 10.222.0.59 "POST /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d/action" status: 202 len: 0 microversion: 2.1 time: 0.545531 Jun 30 10:50:50.281250 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 505/1030] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Jun 30 10:50:49 2022] POST /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d/action => generated 0 bytes in 551 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 10:50:50.287474 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [req-5421dacd-4a96-4f94-bf76-39e8d347b099 req-8bc8f5f4-f73e-46b8-9d16-ef903ba88081 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71a25d37-33ee-4e2f-a2b3-474b211268c4", "tag": "069370ba-0ec4-4f19-914f-312ecbfdf92b"}]} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:50:50.291584 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-48dc8fbc-227c-4c74-a372-f6a116cebbba tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:50.292788 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-48dc8fbc-227c-4c74-a372-f6a116cebbba tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] [instance: 6526331b-07d9-4ae7-8429-187bf752923d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:50.300391 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-5421dacd-4a96-4f94-bf76-39e8d347b099 req-8bc8f5f4-f73e-46b8-9d16-ef903ba88081 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:50.301038 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-48dc8fbc-227c-4c74-a372-f6a116cebbba tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:50.301395 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-5421dacd-4a96-4f94-bf76-39e8d347b099 req-8bc8f5f4-f73e-46b8-9d16-ef903ba88081 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:50.301812 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-48dc8fbc-227c-4c74-a372-f6a116cebbba tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:50.303450 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-48dc8fbc-227c-4c74-a372-f6a116cebbba tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:50.306176 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-48dc8fbc-227c-4c74-a372-f6a116cebbba tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:50.318557 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.compute.server_external_events [req-5421dacd-4a96-4f94-bf76-39e8d347b099 req-8bc8f5f4-f73e-46b8-9d16-ef903ba88081 service nova] Creating event network-changed:069370ba-0ec4-4f19-914f-312ecbfdf92b for instance 71a25d37-33ee-4e2f-a2b3-474b211268c4 on hv-cinder-82282 Jun 30 10:50:50.325328 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [req-5421dacd-4a96-4f94-bf76-39e8d347b099 req-8bc8f5f4-f73e-46b8-9d16-ef903ba88081 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041689 Jun 30 10:50:50.326971 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 506/1031] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:50:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:50:50.521746 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-48dc8fbc-227c-4c74-a372-f6a116cebbba tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a24491b2e4545e289fa4f1cff4f30d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ab649bf434f78b83122111ec19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:50:50.535396 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-48dc8fbc-227c-4c74-a372-f6a116cebbba tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] 10.222.0.59 "GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d" status: 200 len: 1759 microversion: 2.1 time: 0.252908 Jun 30 10:50:50.536211 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 526/1032] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:50:50 2022] GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d => generated 1759 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:50:50.766121 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [req-675e356b-3691-4096-baa3-b581cbbbfe8a req-e297bf06-6ee8-4280-bc49-5e86b692defc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6526331b-07d9-4ae7-8429-187bf752923d", "tag": "1ba7efd4-5bb9-4ada-b21b-02272e12a627"}]} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:50:50.774733 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-675e356b-3691-4096-baa3-b581cbbbfe8a req-e297bf06-6ee8-4280-bc49-5e86b692defc service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:50.775568 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-675e356b-3691-4096-baa3-b581cbbbfe8a req-e297bf06-6ee8-4280-bc49-5e86b692defc service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:50.788182 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.compute.server_external_events [req-675e356b-3691-4096-baa3-b581cbbbfe8a req-e297bf06-6ee8-4280-bc49-5e86b692defc service nova] Creating event network-changed:1ba7efd4-5bb9-4ada-b21b-02272e12a627 for instance 6526331b-07d9-4ae7-8429-187bf752923d on hv-cinder-82282 Jun 30 10:50:50.794250 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [req-675e356b-3691-4096-baa3-b581cbbbfe8a req-e297bf06-6ee8-4280-bc49-5e86b692defc service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032335 Jun 30 10:50:50.795189 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 527/1033] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:50:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 10:50:50.799928 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-32fc1d76-09ad-4957-a40b-8c507737299d tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:50.800728 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-32fc1d76-09ad-4957-a40b-8c507737299d tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: 4ea0da70-2dc2-464e-8b2d-747cb81fed14] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:50.811975 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-32fc1d76-09ad-4957-a40b-8c507737299d tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:50.813156 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-32fc1d76-09ad-4957-a40b-8c507737299d tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:50.814137 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-32fc1d76-09ad-4957-a40b-8c507737299d tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:50.814877 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-32fc1d76-09ad-4957-a40b-8c507737299d tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:50.843592 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-32fc1d76-09ad-4957-a40b-8c507737299d tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/4ea0da70-2dc2-464e-8b2d-747cb81fed14/ips" status: 200 len: 146 microversion: 2.1 time: 0.223548 Jun 30 10:50:50.849725 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 507/1034] 10.222.0.59 () {58 vars in 1247 bytes} [Thu Jun 30 10:50:50 2022] GET /compute/v2.1/servers/4ea0da70-2dc2-464e-8b2d-747cb81fed14/ips => generated 146 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:50:52.237575 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-0f0dd58a-8580-47a6-98e8-c097597790cd tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f4987e20-6e7c-4c25-b969-f0dcce93ceb1"}} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:50:52.238722 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-0f0dd58a-8580-47a6-98e8-c097597790cd tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: 4ea0da70-2dc2-464e-8b2d-747cb81fed14] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:52.246241 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0f0dd58a-8580-47a6-98e8-c097597790cd tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:52.246694 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0f0dd58a-8580-47a6-98e8-c097597790cd tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:52.247455 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0f0dd58a-8580-47a6-98e8-c097597790cd tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:52.247892 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0f0dd58a-8580-47a6-98e8-c097597790cd tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:52.475526 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-0f0dd58a-8580-47a6-98e8-c097597790cd tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "POST /compute/v2.1/servers/4ea0da70-2dc2-464e-8b2d-747cb81fed14/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.242341 Jun 30 10:50:52.476130 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 528/1035] 10.222.0.59 () {60 vars in 1322 bytes} [Thu Jun 30 10:50:52 2022] POST /compute/v2.1/servers/4ea0da70-2dc2-464e-8b2d-747cb81fed14/os-volume_attachments => generated 194 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:50:59.955133 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-01f951a6-0dca-4fb1-b7d0-a736b08ca89c tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:50:59.956229 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-01f951a6-0dca-4fb1-b7d0-a736b08ca89c tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: 4ea0da70-2dc2-464e-8b2d-747cb81fed14] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:50:59.962750 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-01f951a6-0dca-4fb1-b7d0-a736b08ca89c tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:59.963643 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-01f951a6-0dca-4fb1-b7d0-a736b08ca89c tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:59.964421 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-01f951a6-0dca-4fb1-b7d0-a736b08ca89c tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:50:59.964903 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-01f951a6-0dca-4fb1-b7d0-a736b08ca89c tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:50:59.994383 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-01f951a6-0dca-4fb1-b7d0-a736b08ca89c tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/4ea0da70-2dc2-464e-8b2d-747cb81fed14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043907 Jun 30 10:50:59.994931 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 508/1036] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 30 10:50:59 2022] GET /compute/v2.1/servers/4ea0da70-2dc2-464e-8b2d-747cb81fed14/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:51:00.006177 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-e3e0f09f-5da9-4732-b7be-4a0ac8944d78 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:51:00.006765 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-e3e0f09f-5da9-4732-b7be-4a0ac8944d78 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: 4ea0da70-2dc2-464e-8b2d-747cb81fed14] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:51:00.008691 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_api:SELECT=68 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:00.014951 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e3e0f09f-5da9-4732-b7be-4a0ac8944d78 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:51:00.015426 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e3e0f09f-5da9-4732-b7be-4a0ac8944d78 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:51:00.016215 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e3e0f09f-5da9-4732-b7be-4a0ac8944d78 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:51:00.016702 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e3e0f09f-5da9-4732-b7be-4a0ac8944d78 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:51:00.045487 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-e3e0f09f-5da9-4732-b7be-4a0ac8944d78 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/4ea0da70-2dc2-464e-8b2d-747cb81fed14/os-volume_attachments/f4987e20-6e7c-4c25-b969-f0dcce93ceb1" status: 200 len: 194 microversion: 2.1 time: 0.044436 Jun 30 10:51:00.046046 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 529/1037] 10.222.0.59 () {58 vars in 1412 bytes} [Thu Jun 30 10:50:59 2022] GET /compute/v2.1/servers/4ea0da70-2dc2-464e-8b2d-747cb81fed14/os-volume_attachments/f4987e20-6e7c-4c25-b969-f0dcce93ceb1 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:51:01.362885 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-952e64d1-5046-4c8d-b432-553151fd90e3 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "912d3507-3504-4d9d-8ae0-8f2669bcc299"}} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:51:01.363982 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-952e64d1-5046-4c8d-b432-553151fd90e3 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: 4ea0da70-2dc2-464e-8b2d-747cb81fed14] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:51:01.370409 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-952e64d1-5046-4c8d-b432-553151fd90e3 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:51:01.370853 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-952e64d1-5046-4c8d-b432-553151fd90e3 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:51:01.371611 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-952e64d1-5046-4c8d-b432-553151fd90e3 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:51:01.372056 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-952e64d1-5046-4c8d-b432-553151fd90e3 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:51:01.613438 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-952e64d1-5046-4c8d-b432-553151fd90e3 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "POST /compute/v2.1/servers/4ea0da70-2dc2-464e-8b2d-747cb81fed14/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.254363 Jun 30 10:51:01.614248 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 509/1038] 10.222.0.59 () {60 vars in 1322 bytes} [Thu Jun 30 10:51:01 2022] POST /compute/v2.1/servers/4ea0da70-2dc2-464e-8b2d-747cb81fed14/os-volume_attachments => generated 194 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:51:09.098062 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-a1a56fcf-288e-479b-978c-ad17533641a2 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:51:09.099228 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-a1a56fcf-288e-479b-978c-ad17533641a2 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: 4ea0da70-2dc2-464e-8b2d-747cb81fed14] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:51:09.105806 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a1a56fcf-288e-479b-978c-ad17533641a2 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:51:09.106291 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a1a56fcf-288e-479b-978c-ad17533641a2 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:51:09.107063 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a1a56fcf-288e-479b-978c-ad17533641a2 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:51:09.107505 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a1a56fcf-288e-479b-978c-ad17533641a2 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:51:09.111592 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:09.141574 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-a1a56fcf-288e-479b-978c-ad17533641a2 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/4ea0da70-2dc2-464e-8b2d-747cb81fed14/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048314 Jun 30 10:51:09.142132 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 530/1039] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 30 10:51:09 2022] GET /compute/v2.1/servers/4ea0da70-2dc2-464e-8b2d-747cb81fed14/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:51:09.248267 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-5f083065-98a9-4d90-b5fb-1a99a8715ecf tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:51:09.248812 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-5f083065-98a9-4d90-b5fb-1a99a8715ecf tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: 4ea0da70-2dc2-464e-8b2d-747cb81fed14] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:51:09.251184 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_api:SELECT=33 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:09.257009 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5f083065-98a9-4d90-b5fb-1a99a8715ecf tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:51:09.257462 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5f083065-98a9-4d90-b5fb-1a99a8715ecf tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:51:09.258234 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5f083065-98a9-4d90-b5fb-1a99a8715ecf tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:51:09.258672 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-5f083065-98a9-4d90-b5fb-1a99a8715ecf tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:51:09.261143 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:09.289269 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-5f083065-98a9-4d90-b5fb-1a99a8715ecf tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/4ea0da70-2dc2-464e-8b2d-747cb81fed14/os-volume_attachments/f4987e20-6e7c-4c25-b969-f0dcce93ceb1" status: 200 len: 194 microversion: 2.1 time: 0.045400 Jun 30 10:51:09.289856 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 510/1040] 10.222.0.59 () {58 vars in 1412 bytes} [Thu Jun 30 10:51:09 2022] GET /compute/v2.1/servers/4ea0da70-2dc2-464e-8b2d-747cb81fed14/os-volume_attachments/f4987e20-6e7c-4c25-b969-f0dcce93ceb1 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:51:09.300011 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-3bce0705-6ae7-4260-b0bd-9c402551115c tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:51:09.300498 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-3bce0705-6ae7-4260-b0bd-9c402551115c tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: 4ea0da70-2dc2-464e-8b2d-747cb81fed14] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:51:09.306607 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-3bce0705-6ae7-4260-b0bd-9c402551115c tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:51:09.307051 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-3bce0705-6ae7-4260-b0bd-9c402551115c tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:51:09.307803 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-3bce0705-6ae7-4260-b0bd-9c402551115c tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:51:09.308233 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-3bce0705-6ae7-4260-b0bd-9c402551115c tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:51:09.388468 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.objects.instance [None req-3bce0705-6ae7-4260-b0bd-9c402551115c tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lazy-loading 'services' on Instance uuid 4ea0da70-2dc2-464e-8b2d-747cb81fed14 {{(pid=124203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 10:51:09.458073 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-3bce0705-6ae7-4260-b0bd-9c402551115c tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "DELETE /compute/v2.1/servers/4ea0da70-2dc2-464e-8b2d-747cb81fed14/os-volume_attachments/f4987e20-6e7c-4c25-b969-f0dcce93ceb1" status: 202 len: 0 microversion: 2.1 time: 0.162434 Jun 30 10:51:09.458824 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 531/1041] 10.222.0.59 () {58 vars in 1415 bytes} [Thu Jun 30 10:51:09 2022] DELETE /compute/v2.1/servers/4ea0da70-2dc2-464e-8b2d-747cb81fed14/os-volume_attachments/f4987e20-6e7c-4c25-b969-f0dcce93ceb1 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 10:51:11.622072 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-d92ed6de-124d-40f2-866f-4267c2764552 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:51:11.622568 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-d92ed6de-124d-40f2-866f-4267c2764552 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: 4ea0da70-2dc2-464e-8b2d-747cb81fed14] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:51:11.629158 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d92ed6de-124d-40f2-866f-4267c2764552 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:51:11.629609 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d92ed6de-124d-40f2-866f-4267c2764552 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:51:11.630369 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d92ed6de-124d-40f2-866f-4267c2764552 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:51:11.630805 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d92ed6de-124d-40f2-866f-4267c2764552 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:51:11.658933 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-d92ed6de-124d-40f2-866f-4267c2764552 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/4ea0da70-2dc2-464e-8b2d-747cb81fed14/os-volume_attachments/912d3507-3504-4d9d-8ae0-8f2669bcc299" status: 200 len: 194 microversion: 2.1 time: 0.040777 Jun 30 10:51:11.659504 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 511/1042] 10.222.0.59 () {58 vars in 1412 bytes} [Thu Jun 30 10:51:11 2022] GET /compute/v2.1/servers/4ea0da70-2dc2-464e-8b2d-747cb81fed14/os-volume_attachments/912d3507-3504-4d9d-8ae0-8f2669bcc299 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:51:11.669745 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-0b00a4a0-d76d-4b11-a92b-4badd44602b6 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:51:11.670330 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-0b00a4a0-d76d-4b11-a92b-4badd44602b6 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: 4ea0da70-2dc2-464e-8b2d-747cb81fed14] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:51:11.677756 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0b00a4a0-d76d-4b11-a92b-4badd44602b6 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:51:11.678210 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0b00a4a0-d76d-4b11-a92b-4badd44602b6 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:51:11.678980 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0b00a4a0-d76d-4b11-a92b-4badd44602b6 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:51:11.679433 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0b00a4a0-d76d-4b11-a92b-4badd44602b6 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:51:11.760060 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.objects.instance [None req-0b00a4a0-d76d-4b11-a92b-4badd44602b6 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lazy-loading 'services' on Instance uuid 4ea0da70-2dc2-464e-8b2d-747cb81fed14 {{(pid=124203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 10:51:11.830354 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-0b00a4a0-d76d-4b11-a92b-4badd44602b6 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "DELETE /compute/v2.1/servers/4ea0da70-2dc2-464e-8b2d-747cb81fed14/os-volume_attachments/912d3507-3504-4d9d-8ae0-8f2669bcc299" status: 202 len: 0 microversion: 2.1 time: 0.164835 Jun 30 10:51:11.830933 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 532/1043] 10.222.0.59 () {58 vars in 1415 bytes} [Thu Jun 30 10:51:11 2022] DELETE /compute/v2.1/servers/4ea0da70-2dc2-464e-8b2d-747cb81fed14/os-volume_attachments/912d3507-3504-4d9d-8ae0-8f2669bcc299 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 10:51:12.988378 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-207b10c3-ac81-4c79-9367-a2cc7ed26604 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:51:12.989400 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-207b10c3-ac81-4c79-9367-a2cc7ed26604 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: 4ea0da70-2dc2-464e-8b2d-747cb81fed14] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:51:12.995761 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-207b10c3-ac81-4c79-9367-a2cc7ed26604 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:51:12.996204 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-207b10c3-ac81-4c79-9367-a2cc7ed26604 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:51:12.996990 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-207b10c3-ac81-4c79-9367-a2cc7ed26604 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:51:12.997427 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-207b10c3-ac81-4c79-9367-a2cc7ed26604 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:51:13.026035 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-207b10c3-ac81-4c79-9367-a2cc7ed26604 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/4ea0da70-2dc2-464e-8b2d-747cb81fed14/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041628 Jun 30 10:51:13.026573 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 512/1044] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 30 10:51:12 2022] GET /compute/v2.1/servers/4ea0da70-2dc2-464e-8b2d-747cb81fed14/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 30 10:51:13.129156 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-ac8598d8-e541-41c6-8687-e5b66894765f tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:51:13.130173 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-ac8598d8-e541-41c6-8687-e5b66894765f tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: 4ea0da70-2dc2-464e-8b2d-747cb81fed14] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:51:13.137571 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ac8598d8-e541-41c6-8687-e5b66894765f tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:51:13.138024 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ac8598d8-e541-41c6-8687-e5b66894765f tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:51:13.138790 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ac8598d8-e541-41c6-8687-e5b66894765f tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:51:13.139226 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ac8598d8-e541-41c6-8687-e5b66894765f tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:51:13.167530 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-ac8598d8-e541-41c6-8687-e5b66894765f tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/4ea0da70-2dc2-464e-8b2d-747cb81fed14/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043626 Jun 30 10:51:13.167984 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 533/1045] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 30 10:51:13 2022] GET /compute/v2.1/servers/4ea0da70-2dc2-464e-8b2d-747cb81fed14/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 30 10:51:13.223412 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-01358abd-8ac9-4502-afd5-54c21c88d684 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:51:13.223913 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-01358abd-8ac9-4502-afd5-54c21c88d684 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: 4ea0da70-2dc2-464e-8b2d-747cb81fed14] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:51:13.229841 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-01358abd-8ac9-4502-afd5-54c21c88d684 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:51:13.230284 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-01358abd-8ac9-4502-afd5-54c21c88d684 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:51:13.231071 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-01358abd-8ac9-4502-afd5-54c21c88d684 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:51:13.231498 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-01358abd-8ac9-4502-afd5-54c21c88d684 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:51:13.256217 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-01358abd-8ac9-4502-afd5-54c21c88d684 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: 4ea0da70-2dc2-464e-8b2d-747cb81fed14] Going to try to terminate instance {{(pid=124204) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 10:51:13.333035 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-01358abd-8ac9-4502-afd5-54c21c88d684 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "DELETE /compute/v2.1/servers/4ea0da70-2dc2-464e-8b2d-747cb81fed14" status: 204 len: 0 microversion: 2.1 time: 0.112985 Jun 30 10:51:13.333628 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 513/1046] 10.222.0.59 () {58 vars in 1238 bytes} [Thu Jun 30 10:51:13 2022] DELETE /compute/v2.1/servers/4ea0da70-2dc2-464e-8b2d-747cb81fed14 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 10:51:13.342029 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-14964198-ee09-4139-865c-d5cea606caa2 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:51:13.342651 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-14964198-ee09-4139-865c-d5cea606caa2 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: 4ea0da70-2dc2-464e-8b2d-747cb81fed14] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:51:13.348661 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-14964198-ee09-4139-865c-d5cea606caa2 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:51:13.349120 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-14964198-ee09-4139-865c-d5cea606caa2 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:51:13.349912 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-14964198-ee09-4139-865c-d5cea606caa2 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:51:13.350356 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-14964198-ee09-4139-865c-d5cea606caa2 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:51:13.481782 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-14964198-ee09-4139-865c-d5cea606caa2 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:51:13.490099 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-14964198-ee09-4139-865c-d5cea606caa2 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/4ea0da70-2dc2-464e-8b2d-747cb81fed14" status: 200 len: 1673 microversion: 2.1 time: 0.151936 Jun 30 10:51:13.490659 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 534/1047] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:51:13 2022] GET /compute/v2.1/servers/4ea0da70-2dc2-464e-8b2d-747cb81fed14 => generated 1673 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:51:14.508421 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-12642502-4b0e-485a-a342-43f20336bde4 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:51:14.509139 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-12642502-4b0e-485a-a342-43f20336bde4 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: 4ea0da70-2dc2-464e-8b2d-747cb81fed14] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:51:14.516189 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-12642502-4b0e-485a-a342-43f20336bde4 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:51:14.516600 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-12642502-4b0e-485a-a342-43f20336bde4 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:51:14.517351 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-12642502-4b0e-485a-a342-43f20336bde4 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:51:14.517778 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-12642502-4b0e-485a-a342-43f20336bde4 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:51:14.643490 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-12642502-4b0e-485a-a342-43f20336bde4 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:51:14.650914 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-12642502-4b0e-485a-a342-43f20336bde4 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/4ea0da70-2dc2-464e-8b2d-747cb81fed14" status: 200 len: 1673 microversion: 2.1 time: 0.146762 Jun 30 10:51:14.651509 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 514/1048] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:51:14 2022] GET /compute/v2.1/servers/4ea0da70-2dc2-464e-8b2d-747cb81fed14 => generated 1673 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:51:15.667336 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-d8609ff3-d063-48ff-a9f0-78b1eea93eae tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:51:15.667938 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-d8609ff3-d063-48ff-a9f0-78b1eea93eae tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: 4ea0da70-2dc2-464e-8b2d-747cb81fed14] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:51:15.674962 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-d8609ff3-d063-48ff-a9f0-78b1eea93eae tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:51:15.675405 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-d8609ff3-d063-48ff-a9f0-78b1eea93eae tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:51:15.676163 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-d8609ff3-d063-48ff-a9f0-78b1eea93eae tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:51:15.676616 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-d8609ff3-d063-48ff-a9f0-78b1eea93eae tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:51:15.805893 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-d8609ff3-d063-48ff-a9f0-78b1eea93eae tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:51:15.814049 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-d8609ff3-d063-48ff-a9f0-78b1eea93eae tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/4ea0da70-2dc2-464e-8b2d-747cb81fed14" status: 200 len: 1673 microversion: 2.1 time: 0.150630 Jun 30 10:51:15.814620 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 535/1049] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:51:15 2022] GET /compute/v2.1/servers/4ea0da70-2dc2-464e-8b2d-747cb81fed14 => generated 1673 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:51:16.298809 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [req-58bcc235-672f-489e-bd16-8728d91cc183 req-3b831c75-0b16-410a-92a9-17e3e17a05dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ea0da70-2dc2-464e-8b2d-747cb81fed14", "name": "network-vif-deleted", "tag": "e406871b-4573-46e9-a343-7939230a9d1a"}]} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:51:16.308268 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-58bcc235-672f-489e-bd16-8728d91cc183 req-3b831c75-0b16-410a-92a9-17e3e17a05dc service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:51:16.309271 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-58bcc235-672f-489e-bd16-8728d91cc183 req-3b831c75-0b16-410a-92a9-17e3e17a05dc service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:51:16.322113 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.compute.server_external_events [req-58bcc235-672f-489e-bd16-8728d91cc183 req-3b831c75-0b16-410a-92a9-17e3e17a05dc service nova] Creating event network-vif-deleted:e406871b-4573-46e9-a343-7939230a9d1a for instance 4ea0da70-2dc2-464e-8b2d-747cb81fed14 on hv-cinder-82282 Jun 30 10:51:16.328695 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [req-58bcc235-672f-489e-bd16-8728d91cc183 req-3b831c75-0b16-410a-92a9-17e3e17a05dc service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034736 Jun 30 10:51:16.329301 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 515/1050] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:51:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:51:16.831661 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-83fc1eb8-e926-4f06-9143-f4f74fe3cfba tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:51:16.832263 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-83fc1eb8-e926-4f06-9143-f4f74fe3cfba tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: 4ea0da70-2dc2-464e-8b2d-747cb81fed14] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:51:16.838953 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-83fc1eb8-e926-4f06-9143-f4f74fe3cfba tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:51:16.839397 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-83fc1eb8-e926-4f06-9143-f4f74fe3cfba tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:51:16.840152 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-83fc1eb8-e926-4f06-9143-f4f74fe3cfba tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:51:16.840611 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-83fc1eb8-e926-4f06-9143-f4f74fe3cfba tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:51:16.871825 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-83fc1eb8-e926-4f06-9143-f4f74fe3cfba tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:51:16.872605 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-83fc1eb8-e926-4f06-9143-f4f74fe3cfba tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:51:16.873309 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.objects.instance [None req-83fc1eb8-e926-4f06-9143-f4f74fe3cfba tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lazy-loading 'fault' on Instance uuid 4ea0da70-2dc2-464e-8b2d-747cb81fed14 {{(pid=124203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 10:51:16.917431 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-83fc1eb8-e926-4f06-9143-f4f74fe3cfba tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131fb3808ea341618e17256b43862937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a531892a5f9e4964aa9b35519ad72b68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:51:16.926441 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-83fc1eb8-e926-4f06-9143-f4f74fe3cfba tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/4ea0da70-2dc2-464e-8b2d-747cb81fed14" status: 200 len: 1326 microversion: 2.1 time: 0.098474 Jun 30 10:51:16.927359 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 536/1051] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:51:16 2022] GET /compute/v2.1/servers/4ea0da70-2dc2-464e-8b2d-747cb81fed14 => generated 1326 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:51:17.943964 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-151924af-7856-455d-b8d4-d99554c8ccef tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:51:17.944690 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-151924af-7856-455d-b8d4-d99554c8ccef tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: 4ea0da70-2dc2-464e-8b2d-747cb81fed14] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:51:17.951458 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-151924af-7856-455d-b8d4-d99554c8ccef tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:51:17.952410 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-151924af-7856-455d-b8d4-d99554c8ccef tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:51:17.953201 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-151924af-7856-455d-b8d4-d99554c8ccef tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:51:17.953636 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-151924af-7856-455d-b8d4-d99554c8ccef tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:51:17.966571 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.wsgi [None req-151924af-7856-455d-b8d4-d99554c8ccef tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] HTTP exception thrown: Instance 4ea0da70-2dc2-464e-8b2d-747cb81fed14 could not be found. Jun 30 10:51:17.968975 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-151924af-7856-455d-b8d4-d99554c8ccef tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Request method failure captured: Jun 30 10:51:17.968975 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: request: GET /compute/v2.1/servers/4ea0da70-2dc2-464e-8b2d-747cb81fed14 HTTP/1.1 Jun 30 10:51:17.968975 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Accept: application/json Jun 30 10:51:17.968975 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Accept-Encoding: identity Jun 30 10:51:17.968975 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Connection: close Jun 30 10:51:17.968975 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Content-Length: 0 Jun 30 10:51:17.968975 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Content-Type: application/json Jun 30 10:51:17.968975 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Host: 10.222.0.59 Jun 30 10:51:17.968975 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Openstack-System-Scope: None Jun 30 10:51:17.968975 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: User-Agent: python-urllib3/1.26.9 Jun 30 10:51:17.968975 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Auth-Token: gAAAAABivX2Niq6wdQ7smNPbNgMJixqD93gm_JdHSeM_07D1r2ozq1nvPz3nujMo4LpG5EX0oiCjpRShKTd5m0cJ9kBrFk3AhfzWQI4BShG3yU7psx5JbedGKreTDypMQfUlQaDulTx9u_Ipu3kVqOCu-ywbUNZurPgDkaZXPZGk4COYXV4hzeE Jun 30 10:51:17.968975 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Domain-Id: None Jun 30 10:51:17.968975 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Domain-Name: None Jun 30 10:51:17.968975 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Identity-Status: Confirmed Jun 30 10:51:17.968975 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Is-Admin-Project: True Jun 30 10:51:17.968975 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Domain-Id: default Jun 30 10:51:17.968975 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Domain-Name: Default Jun 30 10:51:17.968975 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Id: a531892a5f9e4964aa9b35519ad72b68 Jun 30 10:51:17.968975 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Name: tempest-AttachVolumeTestJSON-815828120 Jun 30 10:51:17.968975 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Role: member,reader Jun 30 10:51:17.968975 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Roles: member,reader Jun 30 10:51:17.970680 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/a531892a5f9e4964aa9b35519ad72b68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_a531892a5f9e4964aa9b35519ad72b68"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a531892a5f9e4964aa9b35519ad72b68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a531892a5f9e4964aa9b35519ad72b68"}]}] Jun 30 10:51:17.970680 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant: tempest-AttachVolumeTestJSON-815828120 Jun 30 10:51:17.970680 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant-Id: a531892a5f9e4964aa9b35519ad72b68 Jun 30 10:51:17.970680 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant-Name: tempest-AttachVolumeTestJSON-815828120 Jun 30 10:51:17.970680 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User: tempest-AttachVolumeTestJSON-815828120-project Jun 30 10:51:17.970680 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Domain-Id: default Jun 30 10:51:17.970680 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Domain-Name: Default Jun 30 10:51:17.970680 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Id: 131fb3808ea341618e17256b43862937 Jun 30 10:51:17.970680 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Name: tempest-AttachVolumeTestJSON-815828120-project Jun 30 10:51:17.970680 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: method: > Jun 30 10:51:17.970680 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: exception: Instance 4ea0da70-2dc2-464e-8b2d-747cb81fed14 could not be found. Jun 30 10:51:17.970680 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: action_args: {'id': '4ea0da70-2dc2-464e-8b2d-747cb81fed14'} Jun 30 10:51:17.971577 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:51:17.971577 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:51:17.971577 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 10:51:17.971577 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 10:51:17.971577 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 10:51:17.971577 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 10:51:17.971577 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 10:51:17.971577 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 10:51:17.971577 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 10:51:17.971577 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 10:51:17.971577 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ea0da70-2dc2-464e-8b2d-747cb81fed14 could not be found. Jun 30 10:51:17.971577 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:51:17.971577 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:51:17.971577 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:51:17.971577 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:51:17.971577 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:51:17.971577 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:51:17.971577 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:51:17.971577 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:51:17.971577 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:51:17.973299 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:51:17.973299 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 10:51:17.973299 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 10:51:17.973299 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 10:51:17.973299 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 10:51:17.973299 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 10:51:17.973299 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:51:17.973299 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ea0da70-2dc2-464e-8b2d-747cb81fed14 could not be found. Jun 30 10:51:17.973299 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:51:17.973299 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:51:17.973299 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:51:17.973299 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:51:17.973299 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:51:17.973299 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:51:17.973299 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:51:17.973299 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:51:17.973299 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ea0da70-2dc2-464e-8b2d-747cb81fed14 could not be found. Jun 30 10:51:17.973299 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:51:17.974744 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-151924af-7856-455d-b8d4-d99554c8ccef tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Returning 404 to user: Instance 4ea0da70-2dc2-464e-8b2d-747cb81fed14 could not be found. {{(pid=124204) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:51:17.974744 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-151924af-7856-455d-b8d4-d99554c8ccef tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/4ea0da70-2dc2-464e-8b2d-747cb81fed14" status: 404 len: 111 microversion: 2.1 time: 0.030704 Jun 30 10:51:17.974744 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 516/1052] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:51:17 2022] GET /compute/v2.1/servers/4ea0da70-2dc2-464e-8b2d-747cb81fed14 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 10:51:17.979044 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-25dda65c-f985-4ceb-acb8-8656d8069a13 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '.version_select at 0x7f4dadd94e50>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:51:17.996137 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-25dda65c-f985-4ceb-acb8-8656d8069a13 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-831061114" status: 202 len: 0 microversion: 2.1 time: 0.020850 Jun 30 10:51:17.996723 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 537/1053] 10.222.0.59 () {58 vars in 1217 bytes} [Thu Jun 30 10:51:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-831061114 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 30 10:51:21.086999 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-c086f5b1-6292-4a24-b6f2-e5ad422993f1 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:51:21.087483 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-c086f5b1-6292-4a24-b6f2-e5ad422993f1 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: 4ea0da70-2dc2-464e-8b2d-747cb81fed14] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:51:21.093965 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c086f5b1-6292-4a24-b6f2-e5ad422993f1 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:51:21.094415 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c086f5b1-6292-4a24-b6f2-e5ad422993f1 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:51:21.095176 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c086f5b1-6292-4a24-b6f2-e5ad422993f1 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:51:21.095613 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c086f5b1-6292-4a24-b6f2-e5ad422993f1 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:51:21.109392 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.wsgi [None req-c086f5b1-6292-4a24-b6f2-e5ad422993f1 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] HTTP exception thrown: Instance 4ea0da70-2dc2-464e-8b2d-747cb81fed14 could not be found. Jun 30 10:51:21.110904 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-c086f5b1-6292-4a24-b6f2-e5ad422993f1 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Request method failure captured: Jun 30 10:51:21.110904 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: request: DELETE /compute/v2.1/servers/4ea0da70-2dc2-464e-8b2d-747cb81fed14 HTTP/1.1 Jun 30 10:51:21.110904 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Accept: application/json Jun 30 10:51:21.110904 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Accept-Encoding: identity Jun 30 10:51:21.110904 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Connection: close Jun 30 10:51:21.110904 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Content-Length: 0 Jun 30 10:51:21.110904 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Content-Type: application/json Jun 30 10:51:21.110904 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Host: 10.222.0.59 Jun 30 10:51:21.110904 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Openstack-System-Scope: None Jun 30 10:51:21.110904 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: User-Agent: python-urllib3/1.26.9 Jun 30 10:51:21.110904 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Auth-Token: gAAAAABivX2Niq6wdQ7smNPbNgMJixqD93gm_JdHSeM_07D1r2ozq1nvPz3nujMo4LpG5EX0oiCjpRShKTd5m0cJ9kBrFk3AhfzWQI4BShG3yU7psx5JbedGKreTDypMQfUlQaDulTx9u_Ipu3kVqOCu-ywbUNZurPgDkaZXPZGk4COYXV4hzeE Jun 30 10:51:21.110904 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Domain-Id: None Jun 30 10:51:21.110904 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Domain-Name: None Jun 30 10:51:21.110904 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Identity-Status: Confirmed Jun 30 10:51:21.110904 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Is-Admin-Project: True Jun 30 10:51:21.110904 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Domain-Id: default Jun 30 10:51:21.110904 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Domain-Name: Default Jun 30 10:51:21.110904 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Id: a531892a5f9e4964aa9b35519ad72b68 Jun 30 10:51:21.110904 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Name: tempest-AttachVolumeTestJSON-815828120 Jun 30 10:51:21.110904 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Role: member,reader Jun 30 10:51:21.110904 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Roles: member,reader Jun 30 10:51:21.112437 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/a531892a5f9e4964aa9b35519ad72b68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_a531892a5f9e4964aa9b35519ad72b68"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a531892a5f9e4964aa9b35519ad72b68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a531892a5f9e4964aa9b35519ad72b68"}]}] Jun 30 10:51:21.112437 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant: tempest-AttachVolumeTestJSON-815828120 Jun 30 10:51:21.112437 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant-Id: a531892a5f9e4964aa9b35519ad72b68 Jun 30 10:51:21.112437 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant-Name: tempest-AttachVolumeTestJSON-815828120 Jun 30 10:51:21.112437 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User: tempest-AttachVolumeTestJSON-815828120-project Jun 30 10:51:21.112437 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Domain-Id: default Jun 30 10:51:21.112437 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Domain-Name: Default Jun 30 10:51:21.112437 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Id: 131fb3808ea341618e17256b43862937 Jun 30 10:51:21.112437 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Name: tempest-AttachVolumeTestJSON-815828120-project Jun 30 10:51:21.112437 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: method: > Jun 30 10:51:21.112437 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: exception: Instance 4ea0da70-2dc2-464e-8b2d-747cb81fed14 could not be found. Jun 30 10:51:21.112437 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: action_args: {'id': '4ea0da70-2dc2-464e-8b2d-747cb81fed14'} Jun 30 10:51:21.113507 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:51:21.113507 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:51:21.113507 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 10:51:21.113507 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 10:51:21.113507 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 10:51:21.113507 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 10:51:21.113507 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 10:51:21.113507 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 10:51:21.113507 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 10:51:21.113507 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 10:51:21.113507 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ea0da70-2dc2-464e-8b2d-747cb81fed14 could not be found. Jun 30 10:51:21.113507 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:51:21.113507 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:51:21.113507 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:51:21.113507 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:51:21.113507 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:51:21.113507 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:51:21.113507 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:51:21.113507 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:51:21.113507 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:51:21.114771 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:51:21.114771 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 10:51:21.114771 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 10:51:21.114771 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 10:51:21.114771 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 10:51:21.114771 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 10:51:21.114771 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 10:51:21.114771 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 10:51:21.114771 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:51:21.114771 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ea0da70-2dc2-464e-8b2d-747cb81fed14 could not be found. Jun 30 10:51:21.114771 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:51:21.114771 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:51:21.114771 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:51:21.114771 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:51:21.114771 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:51:21.114771 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:51:21.114771 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:51:21.114771 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:51:21.114771 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ea0da70-2dc2-464e-8b2d-747cb81fed14 could not be found. Jun 30 10:51:21.114771 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:51:21.116367 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-c086f5b1-6292-4a24-b6f2-e5ad422993f1 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Returning 404 to user: Instance 4ea0da70-2dc2-464e-8b2d-747cb81fed14 could not be found. {{(pid=124204) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:51:21.116367 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-c086f5b1-6292-4a24-b6f2-e5ad422993f1 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "DELETE /compute/v2.1/servers/4ea0da70-2dc2-464e-8b2d-747cb81fed14" status: 404 len: 111 microversion: 2.1 time: 0.029111 Jun 30 10:51:21.116367 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 517/1054] 10.222.0.59 () {58 vars in 1238 bytes} [Thu Jun 30 10:51:21 2022] DELETE /compute/v2.1/servers/4ea0da70-2dc2-464e-8b2d-747cb81fed14 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 10:51:21.121102 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-23a5f50f-6e89-4eb3-beeb-95e64c0ffe86 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:51:21.121713 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-23a5f50f-6e89-4eb3-beeb-95e64c0ffe86 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: 4ea0da70-2dc2-464e-8b2d-747cb81fed14] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:51:21.128275 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-23a5f50f-6e89-4eb3-beeb-95e64c0ffe86 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:51:21.128757 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-23a5f50f-6e89-4eb3-beeb-95e64c0ffe86 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:51:21.129517 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-23a5f50f-6e89-4eb3-beeb-95e64c0ffe86 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:51:21.129954 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-23a5f50f-6e89-4eb3-beeb-95e64c0ffe86 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:51:21.143448 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.wsgi [None req-23a5f50f-6e89-4eb3-beeb-95e64c0ffe86 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] HTTP exception thrown: Instance 4ea0da70-2dc2-464e-8b2d-747cb81fed14 could not be found. Jun 30 10:51:21.145143 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-23a5f50f-6e89-4eb3-beeb-95e64c0ffe86 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Request method failure captured: Jun 30 10:51:21.145143 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: request: GET /compute/v2.1/servers/4ea0da70-2dc2-464e-8b2d-747cb81fed14 HTTP/1.1 Jun 30 10:51:21.145143 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Accept: application/json Jun 30 10:51:21.145143 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Accept-Encoding: identity Jun 30 10:51:21.145143 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Connection: close Jun 30 10:51:21.145143 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Content-Length: 0 Jun 30 10:51:21.145143 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Content-Type: application/json Jun 30 10:51:21.145143 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Host: 10.222.0.59 Jun 30 10:51:21.145143 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Openstack-System-Scope: None Jun 30 10:51:21.145143 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: User-Agent: python-urllib3/1.26.9 Jun 30 10:51:21.145143 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Auth-Token: gAAAAABivX2Niq6wdQ7smNPbNgMJixqD93gm_JdHSeM_07D1r2ozq1nvPz3nujMo4LpG5EX0oiCjpRShKTd5m0cJ9kBrFk3AhfzWQI4BShG3yU7psx5JbedGKreTDypMQfUlQaDulTx9u_Ipu3kVqOCu-ywbUNZurPgDkaZXPZGk4COYXV4hzeE Jun 30 10:51:21.145143 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Domain-Id: None Jun 30 10:51:21.145143 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Domain-Name: None Jun 30 10:51:21.145143 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Identity-Status: Confirmed Jun 30 10:51:21.145143 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Is-Admin-Project: True Jun 30 10:51:21.145143 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Domain-Id: default Jun 30 10:51:21.145143 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Domain-Name: Default Jun 30 10:51:21.145143 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Id: a531892a5f9e4964aa9b35519ad72b68 Jun 30 10:51:21.145143 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Name: tempest-AttachVolumeTestJSON-815828120 Jun 30 10:51:21.145143 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Role: member,reader Jun 30 10:51:21.145143 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Roles: member,reader Jun 30 10:51:21.146707 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/a531892a5f9e4964aa9b35519ad72b68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_a531892a5f9e4964aa9b35519ad72b68"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a531892a5f9e4964aa9b35519ad72b68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a531892a5f9e4964aa9b35519ad72b68"}]}] Jun 30 10:51:21.146707 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant: tempest-AttachVolumeTestJSON-815828120 Jun 30 10:51:21.146707 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant-Id: a531892a5f9e4964aa9b35519ad72b68 Jun 30 10:51:21.146707 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant-Name: tempest-AttachVolumeTestJSON-815828120 Jun 30 10:51:21.146707 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User: tempest-AttachVolumeTestJSON-815828120-project Jun 30 10:51:21.146707 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Domain-Id: default Jun 30 10:51:21.146707 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Domain-Name: Default Jun 30 10:51:21.146707 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Id: 131fb3808ea341618e17256b43862937 Jun 30 10:51:21.146707 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Name: tempest-AttachVolumeTestJSON-815828120-project Jun 30 10:51:21.146707 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: method: > Jun 30 10:51:21.146707 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: exception: Instance 4ea0da70-2dc2-464e-8b2d-747cb81fed14 could not be found. Jun 30 10:51:21.146707 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: action_args: {'id': '4ea0da70-2dc2-464e-8b2d-747cb81fed14'} Jun 30 10:51:21.147675 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:51:21.147675 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:51:21.147675 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 10:51:21.147675 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 10:51:21.147675 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 10:51:21.147675 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 10:51:21.147675 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 10:51:21.147675 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 10:51:21.147675 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 10:51:21.147675 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 10:51:21.147675 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ea0da70-2dc2-464e-8b2d-747cb81fed14 could not be found. Jun 30 10:51:21.147675 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:51:21.147675 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:51:21.147675 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:51:21.147675 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:51:21.147675 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:51:21.147675 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:51:21.147675 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:51:21.147675 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:51:21.147675 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:51:21.148935 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:51:21.148935 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 10:51:21.148935 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 10:51:21.148935 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 10:51:21.148935 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 10:51:21.148935 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 10:51:21.148935 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:51:21.148935 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ea0da70-2dc2-464e-8b2d-747cb81fed14 could not be found. Jun 30 10:51:21.148935 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:51:21.148935 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:51:21.148935 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:51:21.148935 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:51:21.148935 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:51:21.148935 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:51:21.148935 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:51:21.148935 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:51:21.148935 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ea0da70-2dc2-464e-8b2d-747cb81fed14 could not be found. Jun 30 10:51:21.148935 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:51:21.150163 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-23a5f50f-6e89-4eb3-beeb-95e64c0ffe86 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Returning 404 to user: Instance 4ea0da70-2dc2-464e-8b2d-747cb81fed14 could not be found. {{(pid=124203) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:51:21.150163 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-23a5f50f-6e89-4eb3-beeb-95e64c0ffe86 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/4ea0da70-2dc2-464e-8b2d-747cb81fed14" status: 404 len: 111 microversion: 2.1 time: 0.029811 Jun 30 10:51:21.150163 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 538/1055] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:51:21 2022] GET /compute/v2.1/servers/4ea0da70-2dc2-464e-8b2d-747cb81fed14 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 10:51:22.285747 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-b15931d1-0a89-46c5-a47d-0be38b495b81 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:51:22.286239 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-b15931d1-0a89-46c5-a47d-0be38b495b81 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:51:22.292942 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-b15931d1-0a89-46c5-a47d-0be38b495b81 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:51:22.293386 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-b15931d1-0a89-46c5-a47d-0be38b495b81 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:51:22.294164 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-b15931d1-0a89-46c5-a47d-0be38b495b81 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:51:22.294592 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-b15931d1-0a89-46c5-a47d-0be38b495b81 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:51:22.310044 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.wsgi [None req-b15931d1-0a89-46c5-a47d-0be38b495b81 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] HTTP exception thrown: Instance a8379d7c-c539-4cb8-9c06-886aff24e725 could not be found. Jun 30 10:51:22.311566 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-b15931d1-0a89-46c5-a47d-0be38b495b81 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Request method failure captured: Jun 30 10:51:22.311566 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: request: DELETE /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 HTTP/1.1 Jun 30 10:51:22.311566 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Accept: application/json Jun 30 10:51:22.311566 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Accept-Encoding: identity Jun 30 10:51:22.311566 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Connection: close Jun 30 10:51:22.311566 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Content-Length: 0 Jun 30 10:51:22.311566 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Content-Type: application/json Jun 30 10:51:22.311566 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Host: 10.222.0.59 Jun 30 10:51:22.311566 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Openstack-System-Scope: None Jun 30 10:51:22.311566 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: User-Agent: python-urllib3/1.26.9 Jun 30 10:51:22.311566 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Auth-Token: gAAAAABivX2Niq6wdQ7smNPbNgMJixqD93gm_JdHSeM_07D1r2ozq1nvPz3nujMo4LpG5EX0oiCjpRShKTd5m0cJ9kBrFk3AhfzWQI4BShG3yU7psx5JbedGKreTDypMQfUlQaDulTx9u_Ipu3kVqOCu-ywbUNZurPgDkaZXPZGk4COYXV4hzeE Jun 30 10:51:22.311566 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Domain-Id: None Jun 30 10:51:22.311566 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Domain-Name: None Jun 30 10:51:22.311566 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Identity-Status: Confirmed Jun 30 10:51:22.311566 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Is-Admin-Project: True Jun 30 10:51:22.311566 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Domain-Id: default Jun 30 10:51:22.311566 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Domain-Name: Default Jun 30 10:51:22.311566 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Id: a531892a5f9e4964aa9b35519ad72b68 Jun 30 10:51:22.311566 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Name: tempest-AttachVolumeTestJSON-815828120 Jun 30 10:51:22.311566 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Role: member,reader Jun 30 10:51:22.311566 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Roles: member,reader Jun 30 10:51:22.313141 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/a531892a5f9e4964aa9b35519ad72b68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_a531892a5f9e4964aa9b35519ad72b68"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a531892a5f9e4964aa9b35519ad72b68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a531892a5f9e4964aa9b35519ad72b68"}]}] Jun 30 10:51:22.313141 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant: tempest-AttachVolumeTestJSON-815828120 Jun 30 10:51:22.313141 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant-Id: a531892a5f9e4964aa9b35519ad72b68 Jun 30 10:51:22.313141 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant-Name: tempest-AttachVolumeTestJSON-815828120 Jun 30 10:51:22.313141 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User: tempest-AttachVolumeTestJSON-815828120-project Jun 30 10:51:22.313141 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Domain-Id: default Jun 30 10:51:22.313141 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Domain-Name: Default Jun 30 10:51:22.313141 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Id: 131fb3808ea341618e17256b43862937 Jun 30 10:51:22.313141 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Name: tempest-AttachVolumeTestJSON-815828120-project Jun 30 10:51:22.313141 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: method: > Jun 30 10:51:22.313141 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: exception: Instance a8379d7c-c539-4cb8-9c06-886aff24e725 could not be found. Jun 30 10:51:22.313141 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: action_args: {'id': 'a8379d7c-c539-4cb8-9c06-886aff24e725'} Jun 30 10:51:22.313961 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:51:22.313961 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:51:22.313961 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 10:51:22.313961 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 10:51:22.313961 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 10:51:22.313961 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 10:51:22.313961 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 10:51:22.313961 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 10:51:22.313961 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 10:51:22.313961 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 10:51:22.313961 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8379d7c-c539-4cb8-9c06-886aff24e725 could not be found. Jun 30 10:51:22.313961 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:51:22.313961 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:51:22.313961 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:51:22.313961 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:51:22.313961 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:51:22.313961 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:51:22.313961 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:51:22.313961 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:51:22.313961 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:51:22.315176 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:51:22.315176 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 10:51:22.315176 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 10:51:22.315176 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 10:51:22.315176 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 10:51:22.315176 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 10:51:22.315176 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 10:51:22.315176 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 10:51:22.315176 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:51:22.315176 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8379d7c-c539-4cb8-9c06-886aff24e725 could not be found. Jun 30 10:51:22.315176 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:51:22.315176 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:51:22.315176 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:51:22.315176 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:51:22.315176 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:51:22.315176 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:51:22.315176 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:51:22.315176 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:51:22.315176 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8379d7c-c539-4cb8-9c06-886aff24e725 could not be found. Jun 30 10:51:22.315176 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:51:22.316407 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-b15931d1-0a89-46c5-a47d-0be38b495b81 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Returning 404 to user: Instance a8379d7c-c539-4cb8-9c06-886aff24e725 could not be found. {{(pid=124204) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:51:22.316407 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-b15931d1-0a89-46c5-a47d-0be38b495b81 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "DELETE /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 404 len: 111 microversion: 2.1 time: 0.030994 Jun 30 10:51:22.316407 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 518/1056] 10.222.0.59 () {58 vars in 1238 bytes} [Thu Jun 30 10:51:22 2022] DELETE /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 10:51:22.321139 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-9075c3fc-699f-4d15-b2d5-3dda2f404f66 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:51:22.321745 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-9075c3fc-699f-4d15-b2d5-3dda2f404f66 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] [instance: a8379d7c-c539-4cb8-9c06-886aff24e725] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:51:22.328724 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-9075c3fc-699f-4d15-b2d5-3dda2f404f66 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:51:22.329171 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-9075c3fc-699f-4d15-b2d5-3dda2f404f66 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:51:22.329928 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-9075c3fc-699f-4d15-b2d5-3dda2f404f66 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:51:22.330357 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-9075c3fc-699f-4d15-b2d5-3dda2f404f66 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:51:22.345558 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.wsgi [None req-9075c3fc-699f-4d15-b2d5-3dda2f404f66 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] HTTP exception thrown: Instance a8379d7c-c539-4cb8-9c06-886aff24e725 could not be found. Jun 30 10:51:22.347083 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-9075c3fc-699f-4d15-b2d5-3dda2f404f66 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Request method failure captured: Jun 30 10:51:22.347083 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: request: GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 HTTP/1.1 Jun 30 10:51:22.347083 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Accept: application/json Jun 30 10:51:22.347083 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Accept-Encoding: identity Jun 30 10:51:22.347083 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Connection: close Jun 30 10:51:22.347083 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Content-Length: 0 Jun 30 10:51:22.347083 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Content-Type: application/json Jun 30 10:51:22.347083 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Host: 10.222.0.59 Jun 30 10:51:22.347083 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Openstack-System-Scope: None Jun 30 10:51:22.347083 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: User-Agent: python-urllib3/1.26.9 Jun 30 10:51:22.347083 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Auth-Token: gAAAAABivX2Niq6wdQ7smNPbNgMJixqD93gm_JdHSeM_07D1r2ozq1nvPz3nujMo4LpG5EX0oiCjpRShKTd5m0cJ9kBrFk3AhfzWQI4BShG3yU7psx5JbedGKreTDypMQfUlQaDulTx9u_Ipu3kVqOCu-ywbUNZurPgDkaZXPZGk4COYXV4hzeE Jun 30 10:51:22.347083 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Domain-Id: None Jun 30 10:51:22.347083 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Domain-Name: None Jun 30 10:51:22.347083 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Identity-Status: Confirmed Jun 30 10:51:22.347083 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Is-Admin-Project: True Jun 30 10:51:22.347083 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Domain-Id: default Jun 30 10:51:22.347083 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Domain-Name: Default Jun 30 10:51:22.347083 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Id: a531892a5f9e4964aa9b35519ad72b68 Jun 30 10:51:22.347083 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Name: tempest-AttachVolumeTestJSON-815828120 Jun 30 10:51:22.347083 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Role: member,reader Jun 30 10:51:22.347083 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Roles: member,reader Jun 30 10:51:22.348722 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/a531892a5f9e4964aa9b35519ad72b68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_a531892a5f9e4964aa9b35519ad72b68"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a531892a5f9e4964aa9b35519ad72b68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a531892a5f9e4964aa9b35519ad72b68"}]}] Jun 30 10:51:22.348722 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant: tempest-AttachVolumeTestJSON-815828120 Jun 30 10:51:22.348722 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant-Id: a531892a5f9e4964aa9b35519ad72b68 Jun 30 10:51:22.348722 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant-Name: tempest-AttachVolumeTestJSON-815828120 Jun 30 10:51:22.348722 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User: tempest-AttachVolumeTestJSON-815828120-project Jun 30 10:51:22.348722 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Domain-Id: default Jun 30 10:51:22.348722 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Domain-Name: Default Jun 30 10:51:22.348722 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Id: 131fb3808ea341618e17256b43862937 Jun 30 10:51:22.348722 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Name: tempest-AttachVolumeTestJSON-815828120-project Jun 30 10:51:22.348722 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: method: > Jun 30 10:51:22.348722 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: exception: Instance a8379d7c-c539-4cb8-9c06-886aff24e725 could not be found. Jun 30 10:51:22.348722 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: action_args: {'id': 'a8379d7c-c539-4cb8-9c06-886aff24e725'} Jun 30 10:51:22.349689 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:51:22.349689 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:51:22.349689 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 10:51:22.349689 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 10:51:22.349689 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 10:51:22.349689 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 10:51:22.349689 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 10:51:22.349689 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 10:51:22.349689 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 10:51:22.349689 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 10:51:22.349689 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8379d7c-c539-4cb8-9c06-886aff24e725 could not be found. Jun 30 10:51:22.349689 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:51:22.349689 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:51:22.349689 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:51:22.349689 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:51:22.349689 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:51:22.349689 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:51:22.349689 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:51:22.349689 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:51:22.349689 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:51:22.351176 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:51:22.351176 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 10:51:22.351176 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 10:51:22.351176 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 10:51:22.351176 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 10:51:22.351176 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 10:51:22.351176 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:51:22.351176 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8379d7c-c539-4cb8-9c06-886aff24e725 could not be found. Jun 30 10:51:22.351176 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:51:22.351176 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:51:22.351176 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:51:22.351176 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:51:22.351176 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:51:22.351176 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:51:22.351176 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:51:22.351176 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:51:22.351176 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8379d7c-c539-4cb8-9c06-886aff24e725 could not be found. Jun 30 10:51:22.351176 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:51:22.352662 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-9075c3fc-699f-4d15-b2d5-3dda2f404f66 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] Returning 404 to user: Instance a8379d7c-c539-4cb8-9c06-886aff24e725 could not be found. {{(pid=124203) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:51:22.352662 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-9075c3fc-699f-4d15-b2d5-3dda2f404f66 tempest-AttachVolumeTestJSON-815828120 tempest-AttachVolumeTestJSON-815828120-project] 10.222.0.59 "GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725" status: 404 len: 111 microversion: 2.1 time: 0.031046 Jun 30 10:51:22.352662 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 539/1057] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:51:22 2022] GET /compute/v2.1/servers/a8379d7c-c539-4cb8-9c06-886aff24e725 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 10:51:26.342581 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-80769884-54f3-42bb-b0d3-9ede843441d5 tempest-VolumesSnapshotsTestJSON-5913127 tempest-VolumesSnapshotsTestJSON-5913127-project] Action: 'create', calling method: .version_select at 0x7f4dadd7d1f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1459023896"}} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:51:26.622434 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-80769884-54f3-42bb-b0d3-9ede843441d5 tempest-VolumesSnapshotsTestJSON-5913127 tempest-VolumesSnapshotsTestJSON-5913127-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.390567 Jun 30 10:51:26.623065 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 519/1058] 10.222.0.59 () {60 vars in 1154 bytes} [Thu Jun 30 10:51:26 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 392 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 30 10:51:26.634166 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-aa0b8912-bda1-4d2b-a4f4-123a43f12327 tempest-VolumesSnapshotsTestJSON-5913127 tempest-VolumesSnapshotsTestJSON-5913127-project] Calling method '.version_select at 0x7f4dadde0e50>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:51:26.683305 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-aa0b8912-bda1-4d2b-a4f4-123a43f12327 tempest-VolumesSnapshotsTestJSON-5913127 tempest-VolumesSnapshotsTestJSON-5913127-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/3ab2cf4e-6c45-48da-8266-efc55ba112b6" status: 200 len: 345 microversion: 2.1 time: 0.053272 Jun 30 10:51:26.683898 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 540/1059] 10.222.0.59 () {58 vars in 1244 bytes} [Thu Jun 30 10:51:26 2022] GET /compute/v2.1/os-volumes/3ab2cf4e-6c45-48da-8266-efc55ba112b6 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 10:51:27.696258 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-bb7b7948-aa46-440e-9024-8d1655a23f63 tempest-VolumesSnapshotsTestJSON-5913127 tempest-VolumesSnapshotsTestJSON-5913127-project] Calling method '.version_select at 0x7f4dadd89700>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:51:27.741953 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-bb7b7948-aa46-440e-9024-8d1655a23f63 tempest-VolumesSnapshotsTestJSON-5913127 tempest-VolumesSnapshotsTestJSON-5913127-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/3ab2cf4e-6c45-48da-8266-efc55ba112b6" status: 200 len: 346 microversion: 2.1 time: 0.049942 Jun 30 10:51:27.742523 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 520/1060] 10.222.0.59 () {58 vars in 1244 bytes} [Thu Jun 30 10:51:27 2022] GET /compute/v2.1/os-volumes/3ab2cf4e-6c45-48da-8266-efc55ba112b6 => generated 346 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:51:27.754527 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-01e265b6-5dc4-4613-9d93-1b401245caed tempest-VolumesSnapshotsTestJSON-5913127 tempest-VolumesSnapshotsTestJSON-5913127-project] Action: 'create', calling method: .version_select at 0x7f4dadf92820>, body: {"snapshot": {"volume_id": "3ab2cf4e-6c45-48da-8266-efc55ba112b6", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-273832496"}} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:51:27.895740 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-01e265b6-5dc4-4613-9d93-1b401245caed tempest-VolumesSnapshotsTestJSON-5913127 tempest-VolumesSnapshotsTestJSON-5913127-project] 10.222.0.59 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.145398 Jun 30 10:51:27.896320 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 541/1061] 10.222.0.59 () {60 vars in 1161 bytes} [Thu Jun 30 10:51:27 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 10:51:27.906012 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-c3702626-6147-4a5b-91f2-d6467b9dcad2 tempest-VolumesSnapshotsTestJSON-5913127 tempest-VolumesSnapshotsTestJSON-5913127-project] Calling method '.version_select at 0x7f4dadcc59d0>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:51:27.938188 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-c3702626-6147-4a5b-91f2-d6467b9dcad2 tempest-VolumesSnapshotsTestJSON-5913127 tempest-VolumesSnapshotsTestJSON-5913127-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/9ba709a9-80ec-4f4d-aeb7-61f01923af7c" status: 200 len: 286 microversion: 2.1 time: 0.035843 Jun 30 10:51:27.938798 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 521/1062] 10.222.0.59 () {58 vars in 1250 bytes} [Thu Jun 30 10:51:27 2022] GET /compute/v2.1/os-snapshots/9ba709a9-80ec-4f4d-aeb7-61f01923af7c => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 10:51:27.948478 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-c16b46e4-490b-4442-a2e9-644926f1c4f3 tempest-VolumesSnapshotsTestJSON-5913127 tempest-VolumesSnapshotsTestJSON-5913127-project] Calling method '.version_select at 0x7f4dae119820>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:51:27.976804 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-c16b46e4-490b-4442-a2e9-644926f1c4f3 tempest-VolumesSnapshotsTestJSON-5913127 tempest-VolumesSnapshotsTestJSON-5913127-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.032021 Jun 30 10:51:27.977357 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 542/1063] 10.222.0.59 () {58 vars in 1139 bytes} [Thu Jun 30 10:51:27 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:51:27.987433 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-30165a2a-5ad4-4152-b33a-3f75b13970a5 tempest-VolumesSnapshotsTestJSON-5913127 tempest-VolumesSnapshotsTestJSON-5913127-project] Calling method '.version_select at 0x7f4dadd89430>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:51:28.016804 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-30165a2a-5ad4-4152-b33a-3f75b13970a5 tempest-VolumesSnapshotsTestJSON-5913127 tempest-VolumesSnapshotsTestJSON-5913127-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/9ba709a9-80ec-4f4d-aeb7-61f01923af7c" status: 200 len: 286 microversion: 2.1 time: 0.033375 Jun 30 10:51:28.017460 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 522/1064] 10.222.0.59 () {58 vars in 1250 bytes} [Thu Jun 30 10:51:27 2022] GET /compute/v2.1/os-snapshots/9ba709a9-80ec-4f4d-aeb7-61f01923af7c => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:51:29.028253 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-ff0f363b-ef16-44fd-934a-cb91d3101e9c tempest-VolumesSnapshotsTestJSON-5913127 tempest-VolumesSnapshotsTestJSON-5913127-project] Calling method '.version_select at 0x7f4daddaa280>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:51:29.057933 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-ff0f363b-ef16-44fd-934a-cb91d3101e9c tempest-VolumesSnapshotsTestJSON-5913127 tempest-VolumesSnapshotsTestJSON-5913127-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/9ba709a9-80ec-4f4d-aeb7-61f01923af7c" status: 200 len: 286 microversion: 2.1 time: 0.033916 Jun 30 10:51:29.058479 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 543/1065] 10.222.0.59 () {58 vars in 1250 bytes} [Thu Jun 30 10:51:29 2022] GET /compute/v2.1/os-snapshots/9ba709a9-80ec-4f4d-aeb7-61f01923af7c => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:51:30.070156 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-f8c25e50-914f-42ce-870e-afef71d9041f tempest-VolumesSnapshotsTestJSON-5913127 tempest-VolumesSnapshotsTestJSON-5913127-project] Calling method '.version_select at 0x7f4dadd229d0>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:51:30.100332 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-f8c25e50-914f-42ce-870e-afef71d9041f tempest-VolumesSnapshotsTestJSON-5913127 tempest-VolumesSnapshotsTestJSON-5913127-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/9ba709a9-80ec-4f4d-aeb7-61f01923af7c" status: 200 len: 286 microversion: 2.1 time: 0.034481 Jun 30 10:51:30.101012 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 523/1066] 10.222.0.59 () {58 vars in 1250 bytes} [Thu Jun 30 10:51:30 2022] GET /compute/v2.1/os-snapshots/9ba709a9-80ec-4f4d-aeb7-61f01923af7c => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:51:31.113652 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-f16a0128-3804-49ac-a534-4a14b81f0e9a tempest-VolumesSnapshotsTestJSON-5913127 tempest-VolumesSnapshotsTestJSON-5913127-project] Calling method '.version_select at 0x7f4daddbed30>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:51:31.142778 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-f16a0128-3804-49ac-a534-4a14b81f0e9a tempest-VolumesSnapshotsTestJSON-5913127 tempest-VolumesSnapshotsTestJSON-5913127-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/9ba709a9-80ec-4f4d-aeb7-61f01923af7c" status: 200 len: 286 microversion: 2.1 time: 0.033405 Jun 30 10:51:31.143327 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 544/1067] 10.222.0.59 () {58 vars in 1250 bytes} [Thu Jun 30 10:51:31 2022] GET /compute/v2.1/os-snapshots/9ba709a9-80ec-4f4d-aeb7-61f01923af7c => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:51:32.154812 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-9ab964b9-a4f7-41db-9a9d-bfdf17064991 tempest-VolumesSnapshotsTestJSON-5913127 tempest-VolumesSnapshotsTestJSON-5913127-project] Calling method '.version_select at 0x7f4dadd7d820>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:51:32.184723 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-9ab964b9-a4f7-41db-9a9d-bfdf17064991 tempest-VolumesSnapshotsTestJSON-5913127 tempest-VolumesSnapshotsTestJSON-5913127-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/9ba709a9-80ec-4f4d-aeb7-61f01923af7c" status: 200 len: 287 microversion: 2.1 time: 0.034092 Jun 30 10:51:32.185287 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 524/1068] 10.222.0.59 () {58 vars in 1250 bytes} [Thu Jun 30 10:51:32 2022] GET /compute/v2.1/os-snapshots/9ba709a9-80ec-4f4d-aeb7-61f01923af7c => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:51:32.196434 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-e4c3cc9e-400b-4c1c-8f18-8777561c78a2 tempest-VolumesSnapshotsTestJSON-5913127 tempest-VolumesSnapshotsTestJSON-5913127-project] Calling method '.version_select at 0x7f4dadf92670>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:51:32.252253 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-e4c3cc9e-400b-4c1c-8f18-8777561c78a2 tempest-VolumesSnapshotsTestJSON-5913127 tempest-VolumesSnapshotsTestJSON-5913127-project] 10.222.0.59 "DELETE /compute/v2.1/os-snapshots/9ba709a9-80ec-4f4d-aeb7-61f01923af7c" status: 202 len: 0 microversion: 2.1 time: 0.059949 Jun 30 10:51:32.252969 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 545/1069] 10.222.0.59 () {58 vars in 1253 bytes} [Thu Jun 30 10:51:32 2022] DELETE /compute/v2.1/os-snapshots/9ba709a9-80ec-4f4d-aeb7-61f01923af7c => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 10:51:32.264869 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-ee8b0f6c-0abc-45fe-bea8-0a018d3b0836 tempest-VolumesSnapshotsTestJSON-5913127 tempest-VolumesSnapshotsTestJSON-5913127-project] Calling method '.version_select at 0x7f4dadca50d0>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:51:32.290330 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:32.293288 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-ee8b0f6c-0abc-45fe-bea8-0a018d3b0836 tempest-VolumesSnapshotsTestJSON-5913127 tempest-VolumesSnapshotsTestJSON-5913127-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/9ba709a9-80ec-4f4d-aeb7-61f01923af7c" status: 200 len: 286 microversion: 2.1 time: 0.036162 Jun 30 10:51:32.293950 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 525/1070] 10.222.0.59 () {58 vars in 1250 bytes} [Thu Jun 30 10:51:32 2022] GET /compute/v2.1/os-snapshots/9ba709a9-80ec-4f4d-aeb7-61f01923af7c => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:51:33.302531 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_api:SELECT=24,nova_api:DELETE=1 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:33.303282 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_cell1:SELECT=53,nova_cell1:INSERT=2 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:33.307480 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-b178c8b5-24fa-458b-beaa-fba5c491336b tempest-VolumesSnapshotsTestJSON-5913127 tempest-VolumesSnapshotsTestJSON-5913127-project] Calling method '.version_select at 0x7f4db0753940>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:51:33.331952 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.wsgi [None req-b178c8b5-24fa-458b-beaa-fba5c491336b tempest-VolumesSnapshotsTestJSON-5913127 tempest-VolumesSnapshotsTestJSON-5913127-project] HTTP exception thrown: Snapshot 9ba709a9-80ec-4f4d-aeb7-61f01923af7c could not be found. Jun 30 10:51:33.334618 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-b178c8b5-24fa-458b-beaa-fba5c491336b tempest-VolumesSnapshotsTestJSON-5913127 tempest-VolumesSnapshotsTestJSON-5913127-project] Request method failure captured: Jun 30 10:51:33.334618 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: request: GET /compute/v2.1/os-snapshots/9ba709a9-80ec-4f4d-aeb7-61f01923af7c HTTP/1.1 Jun 30 10:51:33.334618 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Accept: application/json Jun 30 10:51:33.334618 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Accept-Encoding: identity Jun 30 10:51:33.334618 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Connection: close Jun 30 10:51:33.334618 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Content-Length: 0 Jun 30 10:51:33.334618 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Content-Type: application/json Jun 30 10:51:33.334618 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Host: 10.222.0.59 Jun 30 10:51:33.334618 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Openstack-System-Scope: None Jun 30 10:51:33.334618 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: User-Agent: python-urllib3/1.26.9 Jun 30 10:51:33.334618 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Auth-Token: gAAAAABivYAu9IzuTIyia85k5n5hXkxgYg_MGDUJRg_BhHnr2orV40P9amQbau1JYVk2iee8P4o6GbVeGyXqQBda12ccF7AoRTPPjgs3waQHLUy1hAPaWgG2_1KgY7RhVHqgOLy1B0idTjJMOC7-pEl6lhCeGkZbN90sWRhHy0skhY4zQmjuNXU Jun 30 10:51:33.334618 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Domain-Id: None Jun 30 10:51:33.334618 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Domain-Name: None Jun 30 10:51:33.334618 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Identity-Status: Confirmed Jun 30 10:51:33.334618 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Is-Admin-Project: True Jun 30 10:51:33.334618 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Domain-Id: default Jun 30 10:51:33.334618 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Domain-Name: Default Jun 30 10:51:33.334618 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Id: ae43fd98d2b1407bb68f444a936d65cd Jun 30 10:51:33.334618 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-5913127 Jun 30 10:51:33.334618 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Role: member,reader Jun 30 10:51:33.334618 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Roles: member,reader Jun 30 10:51:33.336331 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ae43fd98d2b1407bb68f444a936d65cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ae43fd98d2b1407bb68f444a936d65cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ae43fd98d2b1407bb68f444a936d65cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ae43fd98d2b1407bb68f444a936d65cd"}]}] Jun 30 10:51:33.336331 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant: tempest-VolumesSnapshotsTestJSON-5913127 Jun 30 10:51:33.336331 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant-Id: ae43fd98d2b1407bb68f444a936d65cd Jun 30 10:51:33.336331 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-5913127 Jun 30 10:51:33.336331 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User: tempest-VolumesSnapshotsTestJSON-5913127-project Jun 30 10:51:33.336331 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Domain-Id: default Jun 30 10:51:33.336331 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Domain-Name: Default Jun 30 10:51:33.336331 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Id: 9ddd9836ac224c4fbea1b3443da4455e Jun 30 10:51:33.336331 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Name: tempest-VolumesSnapshotsTestJSON-5913127-project Jun 30 10:51:33.336331 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: method: Jun 30 10:51:33.336331 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: exception: Snapshot 9ba709a9-80ec-4f4d-aeb7-61f01923af7c could not be found. Jun 30 10:51:33.336331 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: action_args: {'id': '9ba709a9-80ec-4f4d-aeb7-61f01923af7c'} Jun 30 10:51:33.336331 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:51:33.337365 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:51:33.337365 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 30 10:51:33.337365 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 30 10:51:33.337365 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 30 10:51:33.337365 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 30 10:51:33.337365 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 30 10:51:33.337365 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 30 10:51:33.337365 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 10:51:33.337365 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 10:51:33.337365 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 10:51:33.337365 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 10:51:33.337365 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 10:51:33.337365 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 10:51:33.337365 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 10:51:33.337365 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 10:51:33.337365 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 9ba709a9-80ec-4f4d-aeb7-61f01923af7c could not be found. (HTTP 404) (Request-ID: req-42a0db2c-d449-4d69-a993-597666e3082a) Jun 30 10:51:33.337365 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:51:33.337365 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:51:33.338772 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:51:33.338772 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:51:33.338772 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 30 10:51:33.338772 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 30 10:51:33.338772 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 30 10:51:33.338772 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 30 10:51:33.338772 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 30 10:51:33.338772 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 30 10:51:33.338772 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 30 10:51:33.338772 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 30 10:51:33.338772 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 30 10:51:33.338772 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 30 10:51:33.338772 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 30 10:51:33.338772 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 30 10:51:33.338772 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 30 10:51:33.338772 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 30 10:51:33.338772 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 10:51:33.338772 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 10:51:33.338772 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 10:51:33.340273 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 10:51:33.340273 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 10:51:33.340273 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 10:51:33.340273 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 10:51:33.340273 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 10:51:33.340273 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 9ba709a9-80ec-4f4d-aeb7-61f01923af7c could not be found. Jun 30 10:51:33.340273 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:51:33.340273 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:51:33.340273 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:51:33.340273 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:51:33.340273 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:51:33.340273 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:51:33.340273 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:51:33.340273 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:51:33.340273 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 10:51:33.340273 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 10:51:33.340273 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:51:33.340273 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:51:33.340273 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 30 10:51:33.340273 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:51:33.341870 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 9ba709a9-80ec-4f4d-aeb7-61f01923af7c could not be found. Jun 30 10:51:33.341870 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:51:33.341870 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:51:33.341870 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:51:33.341870 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:51:33.341870 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:51:33.341870 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:51:33.341870 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:51:33.341870 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:51:33.341870 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 9ba709a9-80ec-4f4d-aeb7-61f01923af7c could not be found. Jun 30 10:51:33.341870 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:51:33.341870 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-b178c8b5-24fa-458b-beaa-fba5c491336b tempest-VolumesSnapshotsTestJSON-5913127 tempest-VolumesSnapshotsTestJSON-5913127-project] Returning 404 to user: Snapshot 9ba709a9-80ec-4f4d-aeb7-61f01923af7c could not be found. {{(pid=124203) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:51:33.341870 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-b178c8b5-24fa-458b-beaa-fba5c491336b tempest-VolumesSnapshotsTestJSON-5913127 tempest-VolumesSnapshotsTestJSON-5913127-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/9ba709a9-80ec-4f4d-aeb7-61f01923af7c" status: 404 len: 111 microversion: 2.1 time: 0.034467 Jun 30 10:51:33.341870 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 546/1071] 10.222.0.59 () {58 vars in 1250 bytes} [Thu Jun 30 10:51:33 2022] GET /compute/v2.1/os-snapshots/9ba709a9-80ec-4f4d-aeb7-61f01923af7c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 10:51:33.343577 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:33.346736 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-d5c5f3d6-bc5f-4d1c-adca-45dc68f8008e tempest-VolumesSnapshotsTestJSON-5913127 tempest-VolumesSnapshotsTestJSON-5913127-project] Calling method '.version_select at 0x7f4dadd4ef70>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:51:33.405581 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-d5c5f3d6-bc5f-4d1c-adca-45dc68f8008e tempest-VolumesSnapshotsTestJSON-5913127 tempest-VolumesSnapshotsTestJSON-5913127-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/3ab2cf4e-6c45-48da-8266-efc55ba112b6" status: 202 len: 0 microversion: 2.1 time: 0.064172 Jun 30 10:51:33.406263 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 526/1072] 10.222.0.59 () {58 vars in 1247 bytes} [Thu Jun 30 10:51:33 2022] DELETE /compute/v2.1/os-volumes/3ab2cf4e-6c45-48da-8266-efc55ba112b6 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 10:51:33.414487 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-00eb89c3-5f40-4c73-9ae7-9181181f6ce0 tempest-VolumesSnapshotsTestJSON-5913127 tempest-VolumesSnapshotsTestJSON-5913127-project] Calling method '.version_select at 0x7f4dadde09d0>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:51:33.461855 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-00eb89c3-5f40-4c73-9ae7-9181181f6ce0 tempest-VolumesSnapshotsTestJSON-5913127 tempest-VolumesSnapshotsTestJSON-5913127-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/3ab2cf4e-6c45-48da-8266-efc55ba112b6" status: 200 len: 345 microversion: 2.1 time: 0.051080 Jun 30 10:51:33.462421 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 547/1073] 10.222.0.59 () {58 vars in 1244 bytes} [Thu Jun 30 10:51:33 2022] GET /compute/v2.1/os-volumes/3ab2cf4e-6c45-48da-8266-efc55ba112b6 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:51:34.474492 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-36633d19-0722-41e5-b544-8c963c4d3aef tempest-VolumesSnapshotsTestJSON-5913127 tempest-VolumesSnapshotsTestJSON-5913127-project] Calling method '.version_select at 0x7f4dadd9e040>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:51:34.502989 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.wsgi [None req-36633d19-0722-41e5-b544-8c963c4d3aef tempest-VolumesSnapshotsTestJSON-5913127 tempest-VolumesSnapshotsTestJSON-5913127-project] HTTP exception thrown: Volume 3ab2cf4e-6c45-48da-8266-efc55ba112b6 could not be found. Jun 30 10:51:34.506317 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-36633d19-0722-41e5-b544-8c963c4d3aef tempest-VolumesSnapshotsTestJSON-5913127 tempest-VolumesSnapshotsTestJSON-5913127-project] Request method failure captured: Jun 30 10:51:34.506317 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: request: GET /compute/v2.1/os-volumes/3ab2cf4e-6c45-48da-8266-efc55ba112b6 HTTP/1.1 Jun 30 10:51:34.506317 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Accept: application/json Jun 30 10:51:34.506317 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Accept-Encoding: identity Jun 30 10:51:34.506317 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Connection: close Jun 30 10:51:34.506317 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Content-Length: 0 Jun 30 10:51:34.506317 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Content-Type: application/json Jun 30 10:51:34.506317 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Host: 10.222.0.59 Jun 30 10:51:34.506317 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Openstack-System-Scope: None Jun 30 10:51:34.506317 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: User-Agent: python-urllib3/1.26.9 Jun 30 10:51:34.506317 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Auth-Token: gAAAAABivYAu9IzuTIyia85k5n5hXkxgYg_MGDUJRg_BhHnr2orV40P9amQbau1JYVk2iee8P4o6GbVeGyXqQBda12ccF7AoRTPPjgs3waQHLUy1hAPaWgG2_1KgY7RhVHqgOLy1B0idTjJMOC7-pEl6lhCeGkZbN90sWRhHy0skhY4zQmjuNXU Jun 30 10:51:34.506317 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Domain-Id: None Jun 30 10:51:34.506317 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Domain-Name: None Jun 30 10:51:34.506317 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Identity-Status: Confirmed Jun 30 10:51:34.506317 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Is-Admin-Project: True Jun 30 10:51:34.506317 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Domain-Id: default Jun 30 10:51:34.506317 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Domain-Name: Default Jun 30 10:51:34.506317 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Id: ae43fd98d2b1407bb68f444a936d65cd Jun 30 10:51:34.506317 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-5913127 Jun 30 10:51:34.506317 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Role: member,reader Jun 30 10:51:34.506317 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Roles: member,reader Jun 30 10:51:34.507884 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ae43fd98d2b1407bb68f444a936d65cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ae43fd98d2b1407bb68f444a936d65cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ae43fd98d2b1407bb68f444a936d65cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ae43fd98d2b1407bb68f444a936d65cd"}]}] Jun 30 10:51:34.507884 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant: tempest-VolumesSnapshotsTestJSON-5913127 Jun 30 10:51:34.507884 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant-Id: ae43fd98d2b1407bb68f444a936d65cd Jun 30 10:51:34.507884 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-5913127 Jun 30 10:51:34.507884 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User: tempest-VolumesSnapshotsTestJSON-5913127-project Jun 30 10:51:34.507884 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Domain-Id: default Jun 30 10:51:34.507884 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Domain-Name: Default Jun 30 10:51:34.507884 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Id: 9ddd9836ac224c4fbea1b3443da4455e Jun 30 10:51:34.507884 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Name: tempest-VolumesSnapshotsTestJSON-5913127-project Jun 30 10:51:34.507884 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: method: Jun 30 10:51:34.507884 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: exception: Volume 3ab2cf4e-6c45-48da-8266-efc55ba112b6 could not be found. Jun 30 10:51:34.507884 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: action_args: {'id': '3ab2cf4e-6c45-48da-8266-efc55ba112b6'} Jun 30 10:51:34.507884 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:51:34.508863 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:51:34.508863 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 10:51:34.508863 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 10:51:34.508863 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 30 10:51:34.508863 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 30 10:51:34.508863 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 30 10:51:34.508863 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 30 10:51:34.508863 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 10:51:34.508863 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 10:51:34.508863 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 10:51:34.508863 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 10:51:34.508863 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 10:51:34.508863 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 10:51:34.508863 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 10:51:34.508863 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 10:51:34.508863 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3ab2cf4e-6c45-48da-8266-efc55ba112b6 could not be found. (HTTP 404) (Request-ID: req-f04dbe76-5891-4c0d-b87a-113c317e8a33) Jun 30 10:51:34.508863 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:51:34.508863 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:51:34.508863 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:51:34.510062 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:51:34.510062 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 30 10:51:34.510062 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 30 10:51:34.510062 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 30 10:51:34.510062 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 30 10:51:34.510062 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 30 10:51:34.510062 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 30 10:51:34.510062 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 30 10:51:34.510062 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 30 10:51:34.510062 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 10:51:34.510062 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 10:51:34.510062 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 30 10:51:34.510062 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 30 10:51:34.510062 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 30 10:51:34.510062 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 30 10:51:34.510062 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 10:51:34.510062 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 10:51:34.510062 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 10:51:34.510062 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 10:51:34.511220 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 10:51:34.511220 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 10:51:34.511220 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 10:51:34.511220 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 10:51:34.511220 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3ab2cf4e-6c45-48da-8266-efc55ba112b6 could not be found. Jun 30 10:51:34.511220 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:51:34.511220 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:51:34.511220 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:51:34.511220 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:51:34.511220 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:51:34.511220 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:51:34.511220 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:51:34.511220 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:51:34.511220 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 10:51:34.511220 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 10:51:34.511220 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:51:34.511220 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:51:34.511220 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 30 10:51:34.511220 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:51:34.512407 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3ab2cf4e-6c45-48da-8266-efc55ba112b6 could not be found. Jun 30 10:51:34.512407 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:51:34.512407 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:51:34.512407 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:51:34.512407 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:51:34.512407 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:51:34.512407 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:51:34.512407 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:51:34.512407 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:51:34.512407 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3ab2cf4e-6c45-48da-8266-efc55ba112b6 could not be found. Jun 30 10:51:34.512407 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:51:34.512407 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-36633d19-0722-41e5-b544-8c963c4d3aef tempest-VolumesSnapshotsTestJSON-5913127 tempest-VolumesSnapshotsTestJSON-5913127-project] Returning 404 to user: Volume 3ab2cf4e-6c45-48da-8266-efc55ba112b6 could not be found. {{(pid=124204) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:51:34.512407 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-36633d19-0722-41e5-b544-8c963c4d3aef tempest-VolumesSnapshotsTestJSON-5913127 tempest-VolumesSnapshotsTestJSON-5913127-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/3ab2cf4e-6c45-48da-8266-efc55ba112b6" status: 404 len: 109 microversion: 2.1 time: 0.037675 Jun 30 10:51:34.512407 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 527/1074] 10.222.0.59 () {58 vars in 1244 bytes} [Thu Jun 30 10:51:34 2022] GET /compute/v2.1/os-volumes/3ab2cf4e-6c45-48da-8266-efc55ba112b6 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 10:51:34.522543 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-f150e560-b2f9-4bec-82ea-91921a496a44 tempest-VolumesSnapshotsTestJSON-5913127 tempest-VolumesSnapshotsTestJSON-5913127-project] Calling method '.version_select at 0x7f4daddbedc0>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:51:34.550204 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.wsgi [None req-f150e560-b2f9-4bec-82ea-91921a496a44 tempest-VolumesSnapshotsTestJSON-5913127 tempest-VolumesSnapshotsTestJSON-5913127-project] HTTP exception thrown: Volume 3ab2cf4e-6c45-48da-8266-efc55ba112b6 could not be found. Jun 30 10:51:34.552107 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-f150e560-b2f9-4bec-82ea-91921a496a44 tempest-VolumesSnapshotsTestJSON-5913127 tempest-VolumesSnapshotsTestJSON-5913127-project] Request method failure captured: Jun 30 10:51:34.552107 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: request: DELETE /compute/v2.1/os-volumes/3ab2cf4e-6c45-48da-8266-efc55ba112b6 HTTP/1.1 Jun 30 10:51:34.552107 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Accept: application/json Jun 30 10:51:34.552107 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Accept-Encoding: identity Jun 30 10:51:34.552107 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Connection: close Jun 30 10:51:34.552107 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Content-Length: 0 Jun 30 10:51:34.552107 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Content-Type: application/json Jun 30 10:51:34.552107 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Host: 10.222.0.59 Jun 30 10:51:34.552107 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Openstack-System-Scope: None Jun 30 10:51:34.552107 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: User-Agent: python-urllib3/1.26.9 Jun 30 10:51:34.552107 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Auth-Token: gAAAAABivYAu9IzuTIyia85k5n5hXkxgYg_MGDUJRg_BhHnr2orV40P9amQbau1JYVk2iee8P4o6GbVeGyXqQBda12ccF7AoRTPPjgs3waQHLUy1hAPaWgG2_1KgY7RhVHqgOLy1B0idTjJMOC7-pEl6lhCeGkZbN90sWRhHy0skhY4zQmjuNXU Jun 30 10:51:34.552107 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Domain-Id: None Jun 30 10:51:34.552107 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Domain-Name: None Jun 30 10:51:34.552107 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Identity-Status: Confirmed Jun 30 10:51:34.552107 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Is-Admin-Project: True Jun 30 10:51:34.552107 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Domain-Id: default Jun 30 10:51:34.552107 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Domain-Name: Default Jun 30 10:51:34.552107 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Id: ae43fd98d2b1407bb68f444a936d65cd Jun 30 10:51:34.552107 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-5913127 Jun 30 10:51:34.552107 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Role: member,reader Jun 30 10:51:34.552107 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Roles: member,reader Jun 30 10:51:34.553494 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ae43fd98d2b1407bb68f444a936d65cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ae43fd98d2b1407bb68f444a936d65cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ae43fd98d2b1407bb68f444a936d65cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ae43fd98d2b1407bb68f444a936d65cd"}]}] Jun 30 10:51:34.553494 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant: tempest-VolumesSnapshotsTestJSON-5913127 Jun 30 10:51:34.553494 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant-Id: ae43fd98d2b1407bb68f444a936d65cd Jun 30 10:51:34.553494 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-5913127 Jun 30 10:51:34.553494 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User: tempest-VolumesSnapshotsTestJSON-5913127-project Jun 30 10:51:34.553494 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Domain-Id: default Jun 30 10:51:34.553494 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Domain-Name: Default Jun 30 10:51:34.553494 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Id: 9ddd9836ac224c4fbea1b3443da4455e Jun 30 10:51:34.553494 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Name: tempest-VolumesSnapshotsTestJSON-5913127-project Jun 30 10:51:34.553494 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: method: Jun 30 10:51:34.553494 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: exception: Volume 3ab2cf4e-6c45-48da-8266-efc55ba112b6 could not be found. Jun 30 10:51:34.553494 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: action_args: {'id': '3ab2cf4e-6c45-48da-8266-efc55ba112b6'} Jun 30 10:51:34.553494 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:51:34.554281 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:51:34.554281 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 10:51:34.554281 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 10:51:34.554281 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 30 10:51:34.554281 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 30 10:51:34.554281 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 30 10:51:34.554281 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 30 10:51:34.554281 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 30 10:51:34.554281 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 30 10:51:34.554281 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 30 10:51:34.554281 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 30 10:51:34.554281 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 10:51:34.554281 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 10:51:34.554281 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 10:51:34.554281 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 10:51:34.554281 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3ab2cf4e-6c45-48da-8266-efc55ba112b6 could not be found. (HTTP 404) (Request-ID: req-c00ba30c-f394-453b-a3db-6a3d046c41f9) Jun 30 10:51:34.554281 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:51:34.554281 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:51:34.554281 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:51:34.555609 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:51:34.555609 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 30 10:51:34.555609 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 30 10:51:34.555609 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 30 10:51:34.555609 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 30 10:51:34.555609 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 30 10:51:34.555609 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 30 10:51:34.555609 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 30 10:51:34.555609 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 30 10:51:34.555609 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 10:51:34.555609 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 10:51:34.555609 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 30 10:51:34.555609 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 30 10:51:34.555609 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 30 10:51:34.555609 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 30 10:51:34.555609 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 30 10:51:34.555609 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 30 10:51:34.555609 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 30 10:51:34.555609 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 30 10:51:34.557093 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 10:51:34.557093 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 10:51:34.557093 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 10:51:34.557093 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 10:51:34.557093 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3ab2cf4e-6c45-48da-8266-efc55ba112b6 could not be found. Jun 30 10:51:34.557093 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:51:34.557093 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:51:34.557093 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:51:34.557093 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:51:34.557093 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:51:34.557093 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:51:34.557093 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:51:34.557093 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:51:34.557093 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 10:51:34.557093 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 10:51:34.557093 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:51:34.557093 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:51:34.557093 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 30 10:51:34.557093 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:51:34.558440 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3ab2cf4e-6c45-48da-8266-efc55ba112b6 could not be found. Jun 30 10:51:34.558440 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:51:34.558440 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:51:34.558440 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:51:34.558440 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:51:34.558440 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:51:34.558440 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:51:34.558440 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:51:34.558440 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:51:34.558440 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3ab2cf4e-6c45-48da-8266-efc55ba112b6 could not be found. Jun 30 10:51:34.558440 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:51:34.558440 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-f150e560-b2f9-4bec-82ea-91921a496a44 tempest-VolumesSnapshotsTestJSON-5913127 tempest-VolumesSnapshotsTestJSON-5913127-project] Returning 404 to user: Volume 3ab2cf4e-6c45-48da-8266-efc55ba112b6 could not be found. {{(pid=124203) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:51:34.558440 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-f150e560-b2f9-4bec-82ea-91921a496a44 tempest-VolumesSnapshotsTestJSON-5913127 tempest-VolumesSnapshotsTestJSON-5913127-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/3ab2cf4e-6c45-48da-8266-efc55ba112b6" status: 404 len: 109 microversion: 2.1 time: 0.035505 Jun 30 10:51:34.558440 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 548/1075] 10.222.0.59 () {58 vars in 1247 bytes} [Thu Jun 30 10:51:34 2022] DELETE /compute/v2.1/os-volumes/3ab2cf4e-6c45-48da-8266-efc55ba112b6 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 10:51:34.562890 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-c16b1814-cc19-4db8-9d5f-558cc4460d61 tempest-VolumesSnapshotsTestJSON-5913127 tempest-VolumesSnapshotsTestJSON-5913127-project] Calling method '.version_select at 0x7f4dadd9e310>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:51:34.590002 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.wsgi [None req-c16b1814-cc19-4db8-9d5f-558cc4460d61 tempest-VolumesSnapshotsTestJSON-5913127 tempest-VolumesSnapshotsTestJSON-5913127-project] HTTP exception thrown: Volume 3ab2cf4e-6c45-48da-8266-efc55ba112b6 could not be found. Jun 30 10:51:34.591940 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-c16b1814-cc19-4db8-9d5f-558cc4460d61 tempest-VolumesSnapshotsTestJSON-5913127 tempest-VolumesSnapshotsTestJSON-5913127-project] Request method failure captured: Jun 30 10:51:34.591940 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: request: GET /compute/v2.1/os-volumes/3ab2cf4e-6c45-48da-8266-efc55ba112b6 HTTP/1.1 Jun 30 10:51:34.591940 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Accept: application/json Jun 30 10:51:34.591940 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Accept-Encoding: identity Jun 30 10:51:34.591940 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Connection: close Jun 30 10:51:34.591940 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Content-Length: 0 Jun 30 10:51:34.591940 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Content-Type: application/json Jun 30 10:51:34.591940 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Host: 10.222.0.59 Jun 30 10:51:34.591940 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Openstack-System-Scope: None Jun 30 10:51:34.591940 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: User-Agent: python-urllib3/1.26.9 Jun 30 10:51:34.591940 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Auth-Token: gAAAAABivYAu9IzuTIyia85k5n5hXkxgYg_MGDUJRg_BhHnr2orV40P9amQbau1JYVk2iee8P4o6GbVeGyXqQBda12ccF7AoRTPPjgs3waQHLUy1hAPaWgG2_1KgY7RhVHqgOLy1B0idTjJMOC7-pEl6lhCeGkZbN90sWRhHy0skhY4zQmjuNXU Jun 30 10:51:34.591940 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Domain-Id: None Jun 30 10:51:34.591940 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Domain-Name: None Jun 30 10:51:34.591940 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Identity-Status: Confirmed Jun 30 10:51:34.591940 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Is-Admin-Project: True Jun 30 10:51:34.591940 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Domain-Id: default Jun 30 10:51:34.591940 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Domain-Name: Default Jun 30 10:51:34.591940 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Id: ae43fd98d2b1407bb68f444a936d65cd Jun 30 10:51:34.591940 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-5913127 Jun 30 10:51:34.591940 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Role: member,reader Jun 30 10:51:34.591940 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Roles: member,reader Jun 30 10:51:34.593511 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ae43fd98d2b1407bb68f444a936d65cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ae43fd98d2b1407bb68f444a936d65cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ae43fd98d2b1407bb68f444a936d65cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ae43fd98d2b1407bb68f444a936d65cd"}]}] Jun 30 10:51:34.593511 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant: tempest-VolumesSnapshotsTestJSON-5913127 Jun 30 10:51:34.593511 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant-Id: ae43fd98d2b1407bb68f444a936d65cd Jun 30 10:51:34.593511 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-5913127 Jun 30 10:51:34.593511 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User: tempest-VolumesSnapshotsTestJSON-5913127-project Jun 30 10:51:34.593511 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Domain-Id: default Jun 30 10:51:34.593511 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Domain-Name: Default Jun 30 10:51:34.593511 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Id: 9ddd9836ac224c4fbea1b3443da4455e Jun 30 10:51:34.593511 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Name: tempest-VolumesSnapshotsTestJSON-5913127-project Jun 30 10:51:34.593511 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: method: Jun 30 10:51:34.593511 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: exception: Volume 3ab2cf4e-6c45-48da-8266-efc55ba112b6 could not be found. Jun 30 10:51:34.593511 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: action_args: {'id': '3ab2cf4e-6c45-48da-8266-efc55ba112b6'} Jun 30 10:51:34.593511 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:51:34.594306 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:51:34.594306 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 10:51:34.594306 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 10:51:34.594306 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 30 10:51:34.594306 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 30 10:51:34.594306 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 30 10:51:34.594306 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 30 10:51:34.594306 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 10:51:34.594306 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 10:51:34.594306 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 10:51:34.594306 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 10:51:34.594306 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 10:51:34.594306 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 10:51:34.594306 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 10:51:34.594306 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 10:51:34.594306 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3ab2cf4e-6c45-48da-8266-efc55ba112b6 could not be found. (HTTP 404) (Request-ID: req-c1993d35-7021-46a4-b744-5ab082a86a33) Jun 30 10:51:34.594306 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:51:34.594306 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:51:34.594306 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:51:34.595472 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:51:34.595472 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 30 10:51:34.595472 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 30 10:51:34.595472 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 30 10:51:34.595472 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 30 10:51:34.595472 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 30 10:51:34.595472 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 30 10:51:34.595472 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 30 10:51:34.595472 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 30 10:51:34.595472 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 10:51:34.595472 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 10:51:34.595472 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 30 10:51:34.595472 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 30 10:51:34.595472 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 30 10:51:34.595472 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 30 10:51:34.595472 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 10:51:34.595472 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 10:51:34.595472 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 10:51:34.595472 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 10:51:34.596644 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 10:51:34.596644 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 10:51:34.596644 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 10:51:34.596644 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 10:51:34.596644 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3ab2cf4e-6c45-48da-8266-efc55ba112b6 could not be found. Jun 30 10:51:34.596644 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:51:34.596644 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:51:34.596644 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:51:34.596644 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:51:34.596644 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:51:34.596644 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:51:34.596644 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:51:34.596644 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:51:34.596644 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 10:51:34.596644 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 10:51:34.596644 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:51:34.596644 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:51:34.596644 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 30 10:51:34.596644 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:51:34.597830 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3ab2cf4e-6c45-48da-8266-efc55ba112b6 could not be found. Jun 30 10:51:34.597830 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:51:34.597830 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:51:34.597830 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:51:34.597830 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:51:34.597830 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:51:34.597830 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:51:34.597830 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:51:34.597830 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:51:34.597830 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3ab2cf4e-6c45-48da-8266-efc55ba112b6 could not be found. Jun 30 10:51:34.597830 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:51:34.597830 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-c16b1814-cc19-4db8-9d5f-558cc4460d61 tempest-VolumesSnapshotsTestJSON-5913127 tempest-VolumesSnapshotsTestJSON-5913127-project] Returning 404 to user: Volume 3ab2cf4e-6c45-48da-8266-efc55ba112b6 could not be found. {{(pid=124204) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:51:34.597830 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-c16b1814-cc19-4db8-9d5f-558cc4460d61 tempest-VolumesSnapshotsTestJSON-5913127 tempest-VolumesSnapshotsTestJSON-5913127-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/3ab2cf4e-6c45-48da-8266-efc55ba112b6" status: 404 len: 109 microversion: 2.1 time: 0.035249 Jun 30 10:51:34.597830 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 528/1076] 10.222.0.59 () {58 vars in 1244 bytes} [Thu Jun 30 10:51:34 2022] GET /compute/v2.1/os-volumes/3ab2cf4e-6c45-48da-8266-efc55ba112b6 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 10:51:57.043480 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 10:51:57.044175 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Thu Jun 30 10:51:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 10:51:58.505920 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-33e344e6-fca3-40bc-8e81-7d73900e8387 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:51:58.506919 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-33e344e6-fca3-40bc-8e81-7d73900e8387 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] [instance: 6526331b-07d9-4ae7-8429-187bf752923d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:51:58.513551 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-33e344e6-fca3-40bc-8e81-7d73900e8387 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:51:58.514178 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-33e344e6-fca3-40bc-8e81-7d73900e8387 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:51:58.514761 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-33e344e6-fca3-40bc-8e81-7d73900e8387 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:51:58.515195 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-33e344e6-fca3-40bc-8e81-7d73900e8387 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:51:58.585521 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-33e344e6-fca3-40bc-8e81-7d73900e8387 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] 10.222.0.59 "POST /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d/action" status: 202 len: 0 microversion: 2.1 time: 0.084220 Jun 30 10:51:58.586537 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 549/1077] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Jun 30 10:51:58 2022] POST /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 10:51:58.599361 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-795f7403-ce31-4be0-95ac-20d23ff89e9f tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:51:58.601752 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-795f7403-ce31-4be0-95ac-20d23ff89e9f tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] [instance: 6526331b-07d9-4ae7-8429-187bf752923d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:51:58.613113 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-795f7403-ce31-4be0-95ac-20d23ff89e9f tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:51:58.613778 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-795f7403-ce31-4be0-95ac-20d23ff89e9f tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:51:58.614753 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-795f7403-ce31-4be0-95ac-20d23ff89e9f tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:51:58.615331 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-795f7403-ce31-4be0-95ac-20d23ff89e9f tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:51:58.796061 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-795f7403-ce31-4be0-95ac-20d23ff89e9f tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a24491b2e4545e289fa4f1cff4f30d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ab649bf434f78b83122111ec19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:51:58.804599 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-795f7403-ce31-4be0-95ac-20d23ff89e9f tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] 10.222.0.59 "GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d" status: 200 len: 1751 microversion: 2.1 time: 0.212995 Jun 30 10:51:58.805612 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 529/1078] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:51:58 2022] GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d => generated 1751 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:51:59.824141 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-5886f270-31a1-44d0-8cdb-cf523323abee tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:51:59.824724 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-5886f270-31a1-44d0-8cdb-cf523323abee tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] [instance: 6526331b-07d9-4ae7-8429-187bf752923d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:51:59.831604 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-5886f270-31a1-44d0-8cdb-cf523323abee tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:51:59.831969 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-5886f270-31a1-44d0-8cdb-cf523323abee tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:51:59.832776 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-5886f270-31a1-44d0-8cdb-cf523323abee tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:51:59.833220 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-5886f270-31a1-44d0-8cdb-cf523323abee tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:51:59.980132 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-5886f270-31a1-44d0-8cdb-cf523323abee tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a24491b2e4545e289fa4f1cff4f30d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ab649bf434f78b83122111ec19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:51:59.988727 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-5886f270-31a1-44d0-8cdb-cf523323abee tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] 10.222.0.59 "GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d" status: 200 len: 1756 microversion: 2.1 time: 0.169210 Jun 30 10:51:59.989301 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 550/1079] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:51:59 2022] GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:52:01.007728 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-7f234d26-38ee-46f6-b7fa-e5b74e07e424 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:52:01.008354 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-7f234d26-38ee-46f6-b7fa-e5b74e07e424 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] [instance: 6526331b-07d9-4ae7-8429-187bf752923d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:52:01.016053 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-7f234d26-38ee-46f6-b7fa-e5b74e07e424 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:01.016525 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-7f234d26-38ee-46f6-b7fa-e5b74e07e424 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:01.017310 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-7f234d26-38ee-46f6-b7fa-e5b74e07e424 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:01.017748 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-7f234d26-38ee-46f6-b7fa-e5b74e07e424 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:01.160242 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-7f234d26-38ee-46f6-b7fa-e5b74e07e424 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a24491b2e4545e289fa4f1cff4f30d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ab649bf434f78b83122111ec19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:52:01.168207 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-7f234d26-38ee-46f6-b7fa-e5b74e07e424 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] 10.222.0.59 "GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d" status: 200 len: 1756 microversion: 2.1 time: 0.164734 Jun 30 10:52:01.168837 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 530/1080] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:52:01 2022] GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:52:02.184453 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-3c7a2486-64fb-4b79-a913-0222f0a9a4c9 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:52:02.185084 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-3c7a2486-64fb-4b79-a913-0222f0a9a4c9 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] [instance: 6526331b-07d9-4ae7-8429-187bf752923d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:52:02.191541 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-3c7a2486-64fb-4b79-a913-0222f0a9a4c9 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:02.192021 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-3c7a2486-64fb-4b79-a913-0222f0a9a4c9 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:02.192800 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-3c7a2486-64fb-4b79-a913-0222f0a9a4c9 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:02.193241 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-3c7a2486-64fb-4b79-a913-0222f0a9a4c9 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:02.307246 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-74d8dfa9-6337-446b-a7b3-957f805098d7 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:52:02.308197 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-74d8dfa9-6337-446b-a7b3-957f805098d7 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:52:02.314744 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-74d8dfa9-6337-446b-a7b3-957f805098d7 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:02.315195 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-74d8dfa9-6337-446b-a7b3-957f805098d7 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:02.315974 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-74d8dfa9-6337-446b-a7b3-957f805098d7 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:02.316411 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-74d8dfa9-6337-446b-a7b3-957f805098d7 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:02.351641 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-74d8dfa9-6337-446b-a7b3-957f805098d7 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048277 Jun 30 10:52:02.352129 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 531/1081] 10.222.0.59 () {60 vars in 1342 bytes} [Thu Jun 30 10:52:02 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:52:02.357019 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-3c7a2486-64fb-4b79-a913-0222f0a9a4c9 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a24491b2e4545e289fa4f1cff4f30d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ab649bf434f78b83122111ec19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:52:02.366090 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-3c7a2486-64fb-4b79-a913-0222f0a9a4c9 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] 10.222.0.59 "GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d" status: 200 len: 1756 microversion: 2.1 time: 0.185409 Jun 30 10:52:02.366738 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 551/1082] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:52:02 2022] GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d => generated 1756 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:52:02.411159 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-baba7298-d556-4fcb-92f7-af24fb223b0d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:52:02.411655 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-baba7298-d556-4fcb-92f7-af24fb223b0d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:52:02.417768 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-baba7298-d556-4fcb-92f7-af24fb223b0d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:02.418225 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-baba7298-d556-4fcb-92f7-af24fb223b0d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:02.418991 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-baba7298-d556-4fcb-92f7-af24fb223b0d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:02.419428 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-baba7298-d556-4fcb-92f7-af24fb223b0d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:02.445513 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-baba7298-d556-4fcb-92f7-af24fb223b0d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Going to try to terminate instance {{(pid=124204) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 10:52:02.522362 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-baba7298-d556-4fcb-92f7-af24fb223b0d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "DELETE /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224" status: 204 len: 0 microversion: 2.20 time: 0.114639 Jun 30 10:52:02.523139 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 532/1083] 10.222.0.59 () {60 vars in 1279 bytes} [Thu Jun 30 10:52:02 2022] DELETE /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 30 10:52:02.531646 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-991745f6-0cd7-4be6-a86c-a027f5ffa007 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:52:02.533110 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-991745f6-0cd7-4be6-a86c-a027f5ffa007 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:52:02.539097 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-991745f6-0cd7-4be6-a86c-a027f5ffa007 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:02.539568 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-991745f6-0cd7-4be6-a86c-a027f5ffa007 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:02.540351 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-991745f6-0cd7-4be6-a86c-a027f5ffa007 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:02.540854 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-991745f6-0cd7-4be6-a86c-a027f5ffa007 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:02.733403 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-991745f6-0cd7-4be6-a86c-a027f5ffa007 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:52:02.742995 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-991745f6-0cd7-4be6-a86c-a027f5ffa007 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:52:02.743115 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-991745f6-0cd7-4be6-a86c-a027f5ffa007 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:52:02.744298 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-991745f6-0cd7-4be6-a86c-a027f5ffa007 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224" status: 200 len: 1721 microversion: 2.20 time: 0.216616 Jun 30 10:52:02.745311 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 552/1084] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:52:02 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 => generated 1721 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:52:03.385208 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-26e1c938-f898-41a9-a1a8-84c5ade0ac2e tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:52:03.385918 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-26e1c938-f898-41a9-a1a8-84c5ade0ac2e tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] [instance: 6526331b-07d9-4ae7-8429-187bf752923d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:52:03.393337 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-26e1c938-f898-41a9-a1a8-84c5ade0ac2e tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:03.393728 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-26e1c938-f898-41a9-a1a8-84c5ade0ac2e tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:03.394487 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-26e1c938-f898-41a9-a1a8-84c5ade0ac2e tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:03.394916 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-26e1c938-f898-41a9-a1a8-84c5ade0ac2e tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:03.540746 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-26e1c938-f898-41a9-a1a8-84c5ade0ac2e tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a24491b2e4545e289fa4f1cff4f30d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ab649bf434f78b83122111ec19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:52:03.549852 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-26e1c938-f898-41a9-a1a8-84c5ade0ac2e tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] 10.222.0.59 "GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d" status: 200 len: 1756 microversion: 2.1 time: 0.169142 Jun 30 10:52:03.550429 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 533/1085] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:52:03 2022] GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:52:03.764595 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-c0cb4eb6-6325-452d-8418-f1171d5ddc6d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:52:03.765127 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-c0cb4eb6-6325-452d-8418-f1171d5ddc6d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:52:03.772171 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c0cb4eb6-6325-452d-8418-f1171d5ddc6d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:03.772683 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c0cb4eb6-6325-452d-8418-f1171d5ddc6d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:03.773448 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c0cb4eb6-6325-452d-8418-f1171d5ddc6d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:03.773884 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c0cb4eb6-6325-452d-8418-f1171d5ddc6d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:03.952589 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-c0cb4eb6-6325-452d-8418-f1171d5ddc6d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:52:03.960569 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-c0cb4eb6-6325-452d-8418-f1171d5ddc6d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:52:03.962312 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-c0cb4eb6-6325-452d-8418-f1171d5ddc6d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:52:03.963672 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-c0cb4eb6-6325-452d-8418-f1171d5ddc6d tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224" status: 200 len: 1721 microversion: 2.20 time: 0.203656 Jun 30 10:52:03.964222 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 553/1086] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:52:03 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 => generated 1721 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:52:04.570213 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-32a472f7-c0ac-4a48-a988-e47cda5d2584 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:52:04.571546 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-32a472f7-c0ac-4a48-a988-e47cda5d2584 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] [instance: 6526331b-07d9-4ae7-8429-187bf752923d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:52:04.581725 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-32a472f7-c0ac-4a48-a988-e47cda5d2584 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:04.582387 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-32a472f7-c0ac-4a48-a988-e47cda5d2584 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:04.583329 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-32a472f7-c0ac-4a48-a988-e47cda5d2584 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:04.583925 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-32a472f7-c0ac-4a48-a988-e47cda5d2584 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:04.750564 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-32a472f7-c0ac-4a48-a988-e47cda5d2584 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a24491b2e4545e289fa4f1cff4f30d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ab649bf434f78b83122111ec19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:52:04.760783 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-32a472f7-c0ac-4a48-a988-e47cda5d2584 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] 10.222.0.59 "GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d" status: 200 len: 1756 microversion: 2.1 time: 0.196176 Jun 30 10:52:04.761719 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 534/1087] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:52:04 2022] GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d => generated 1756 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:52:04.983259 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-3ddd09ad-5cb5-4aa2-9f6f-0b95bbb8ecda tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:52:04.983870 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-3ddd09ad-5cb5-4aa2-9f6f-0b95bbb8ecda tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:52:04.992119 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-3ddd09ad-5cb5-4aa2-9f6f-0b95bbb8ecda tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:04.992924 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-3ddd09ad-5cb5-4aa2-9f6f-0b95bbb8ecda tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:04.993936 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-3ddd09ad-5cb5-4aa2-9f6f-0b95bbb8ecda tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:04.994578 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-3ddd09ad-5cb5-4aa2-9f6f-0b95bbb8ecda tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:05.164828 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [req-f656f8d8-1378-48a0-98dc-fedcf3a60d60 req-4b05e522-61cb-4fad-a0b2-ad0e83dd65f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a6b5e16-473d-4317-8bf7-ee0df07cb224", "name": "network-vif-deleted", "tag": "616d9e47-3706-4db1-a51a-9e45603ab16c"}]} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:52:05.176350 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-f656f8d8-1378-48a0-98dc-fedcf3a60d60 req-4b05e522-61cb-4fad-a0b2-ad0e83dd65f6 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:05.184468 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-f656f8d8-1378-48a0-98dc-fedcf3a60d60 req-4b05e522-61cb-4fad-a0b2-ad0e83dd65f6 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:05.197231 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.compute.server_external_events [req-f656f8d8-1378-48a0-98dc-fedcf3a60d60 req-4b05e522-61cb-4fad-a0b2-ad0e83dd65f6 service nova] Creating event network-vif-deleted:616d9e47-3706-4db1-a51a-9e45603ab16c for instance 7a6b5e16-473d-4317-8bf7-ee0df07cb224 on hv-cinder-82282 Jun 30 10:52:05.204695 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [req-f656f8d8-1378-48a0-98dc-fedcf3a60d60 req-4b05e522-61cb-4fad-a0b2-ad0e83dd65f6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043248 Jun 30 10:52:05.210027 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 535/1088] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:52:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 10:52:05.372093 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-3ddd09ad-5cb5-4aa2-9f6f-0b95bbb8ecda tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:52:05.386712 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-3ddd09ad-5cb5-4aa2-9f6f-0b95bbb8ecda tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:52:05.388627 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-3ddd09ad-5cb5-4aa2-9f6f-0b95bbb8ecda tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5003e984d58440a80d98405d187eab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2346c16770124c9a86bc6e30880f8bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:52:05.390476 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-3ddd09ad-5cb5-4aa2-9f6f-0b95bbb8ecda tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224" status: 200 len: 1654 microversion: 2.20 time: 0.411795 Jun 30 10:52:05.391474 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 554/1089] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:52:04 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 => generated 1654 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:52:05.778631 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-4e9133b6-9c7a-440b-ac77-e6f7d9ab87fc tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:52:05.780483 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-4e9133b6-9c7a-440b-ac77-e6f7d9ab87fc tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] [instance: 6526331b-07d9-4ae7-8429-187bf752923d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:52:05.787906 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-4e9133b6-9c7a-440b-ac77-e6f7d9ab87fc tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:05.788581 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-4e9133b6-9c7a-440b-ac77-e6f7d9ab87fc tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:05.789557 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-4e9133b6-9c7a-440b-ac77-e6f7d9ab87fc tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:05.790369 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-4e9133b6-9c7a-440b-ac77-e6f7d9ab87fc tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:05.938650 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-4e9133b6-9c7a-440b-ac77-e6f7d9ab87fc tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a24491b2e4545e289fa4f1cff4f30d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ab649bf434f78b83122111ec19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:52:05.946689 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-4e9133b6-9c7a-440b-ac77-e6f7d9ab87fc tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] 10.222.0.59 "GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d" status: 200 len: 1756 microversion: 2.1 time: 0.172760 Jun 30 10:52:05.956566 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 536/1090] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:52:05 2022] GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d => generated 1756 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:52:06.408524 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-8181c04d-0e6a-4529-a3b7-c2caac8c581e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:52:06.409153 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-8181c04d-0e6a-4529-a3b7-c2caac8c581e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:52:06.415903 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-8181c04d-0e6a-4529-a3b7-c2caac8c581e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:06.416350 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-8181c04d-0e6a-4529-a3b7-c2caac8c581e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:06.417152 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-8181c04d-0e6a-4529-a3b7-c2caac8c581e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:06.417587 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-8181c04d-0e6a-4529-a3b7-c2caac8c581e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:06.431738 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.wsgi [None req-8181c04d-0e6a-4529-a3b7-c2caac8c581e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] HTTP exception thrown: Instance 7a6b5e16-473d-4317-8bf7-ee0df07cb224 could not be found. Jun 30 10:52:06.433469 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-8181c04d-0e6a-4529-a3b7-c2caac8c581e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Request method failure captured: Jun 30 10:52:06.433469 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: request: GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 HTTP/1.1 Jun 30 10:52:06.433469 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Accept: application/json Jun 30 10:52:06.433469 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Accept-Encoding: identity Jun 30 10:52:06.433469 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Connection: close Jun 30 10:52:06.433469 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Content-Length: 0 Jun 30 10:52:06.433469 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Content-Type: application/json Jun 30 10:52:06.433469 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Host: 10.222.0.59 Jun 30 10:52:06.433469 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Openstack-System-Scope: None Jun 30 10:52:06.433469 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: User-Agent: python-urllib3/1.26.9 Jun 30 10:52:06.433469 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Auth-Token: gAAAAABivX2O95PG7OwLZsazVloASqbVmipNAFm6f7qcVY4E3WlX41rd0tnm80pMeaWUbOtnrlH_CSuCdrIaArMqD9imR93SBX_VhBipTNZO_mJ8xWvurtwepIWU8hq9tEB4LqdDH4ZWPwmoyVcMweVJSiWAHLPtJvaEwnl-rQ0OwuRu2pw1LVY Jun 30 10:52:06.433469 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Domain-Id: None Jun 30 10:52:06.433469 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Domain-Name: None Jun 30 10:52:06.433469 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Identity-Status: Confirmed Jun 30 10:52:06.433469 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Is-Admin-Project: True Jun 30 10:52:06.433469 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Openstack-Nova-Api-Version: 2.20 Jun 30 10:52:06.433469 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Domain-Id: default Jun 30 10:52:06.433469 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Domain-Name: Default Jun 30 10:52:06.433469 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Id: 2346c16770124c9a86bc6e30880f8bde Jun 30 10:52:06.433469 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2033035787 Jun 30 10:52:06.433469 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Role: member,reader Jun 30 10:52:06.433469 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Roles: member,reader Jun 30 10:52:06.435209 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/2346c16770124c9a86bc6e30880f8bde"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_2346c16770124c9a86bc6e30880f8bde"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2346c16770124c9a86bc6e30880f8bde"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2346c16770124c9a86bc6e30880f8bde"}]}] Jun 30 10:52:06.435209 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2033035787 Jun 30 10:52:06.435209 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant-Id: 2346c16770124c9a86bc6e30880f8bde Jun 30 10:52:06.435209 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2033035787 Jun 30 10:52:06.435209 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User: tempest-AttachVolumeShelveTestJSON-2033035787-project Jun 30 10:52:06.435209 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Domain-Id: default Jun 30 10:52:06.435209 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Domain-Name: Default Jun 30 10:52:06.435209 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Id: f5003e984d58440a80d98405d187eab0 Jun 30 10:52:06.435209 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2033035787-project Jun 30 10:52:06.435209 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: method: > Jun 30 10:52:06.435209 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: exception: Instance 7a6b5e16-473d-4317-8bf7-ee0df07cb224 could not be found. Jun 30 10:52:06.435209 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: action_args: {'id': '7a6b5e16-473d-4317-8bf7-ee0df07cb224'} Jun 30 10:52:06.436601 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:52:06.436601 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:52:06.436601 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 10:52:06.436601 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 10:52:06.436601 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 10:52:06.436601 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 10:52:06.436601 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 10:52:06.436601 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 10:52:06.436601 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 10:52:06.436601 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 10:52:06.436601 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a6b5e16-473d-4317-8bf7-ee0df07cb224 could not be found. Jun 30 10:52:06.436601 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:52:06.436601 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:52:06.436601 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:52:06.436601 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:52:06.436601 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:52:06.436601 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:52:06.436601 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:52:06.436601 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:52:06.436601 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:52:06.438116 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:52:06.438116 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 10:52:06.438116 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 10:52:06.438116 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 10:52:06.438116 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 10:52:06.438116 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 10:52:06.438116 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:52:06.438116 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a6b5e16-473d-4317-8bf7-ee0df07cb224 could not be found. Jun 30 10:52:06.438116 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:52:06.438116 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:52:06.438116 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:52:06.438116 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:52:06.438116 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:52:06.438116 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:52:06.438116 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:52:06.438116 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:52:06.438116 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a6b5e16-473d-4317-8bf7-ee0df07cb224 could not be found. Jun 30 10:52:06.438116 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:52:06.439496 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-8181c04d-0e6a-4529-a3b7-c2caac8c581e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Returning 404 to user: Instance 7a6b5e16-473d-4317-8bf7-ee0df07cb224 could not be found. {{(pid=124203) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:52:06.439496 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-8181c04d-0e6a-4529-a3b7-c2caac8c581e tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224" status: 404 len: 111 microversion: 2.20 time: 0.030450 Jun 30 10:52:06.439496 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 555/1091] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:52:06 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 30 10:52:06.444466 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-2de408b6-8b2d-43d9-b06d-361a9faee7be tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '.version_select at 0x7f4dadde4f70>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:52:06.465476 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-2de408b6-8b2d-43d9-b06d-361a9faee7be tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-671486942" status: 204 len: 0 microversion: 2.20 time: 0.024831 Jun 30 10:52:06.466067 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 537/1092] 10.222.0.59 () {60 vars in 1258 bytes} [Thu Jun 30 10:52:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-671486942 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 30 10:52:06.963980 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-1493723d-5a86-46d0-b119-bfbb969dc5d0 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:52:06.964610 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-1493723d-5a86-46d0-b119-bfbb969dc5d0 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] [instance: 6526331b-07d9-4ae7-8429-187bf752923d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:52:06.970666 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-1493723d-5a86-46d0-b119-bfbb969dc5d0 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:06.971106 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-1493723d-5a86-46d0-b119-bfbb969dc5d0 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:06.971866 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-1493723d-5a86-46d0-b119-bfbb969dc5d0 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:06.972347 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-1493723d-5a86-46d0-b119-bfbb969dc5d0 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:07.162028 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-1493723d-5a86-46d0-b119-bfbb969dc5d0 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a24491b2e4545e289fa4f1cff4f30d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ab649bf434f78b83122111ec19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:52:07.170898 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-1493723d-5a86-46d0-b119-bfbb969dc5d0 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] 10.222.0.59 "GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d" status: 200 len: 1756 microversion: 2.1 time: 0.210709 Jun 30 10:52:07.180795 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 556/1093] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:52:06 2022] GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d => generated 1756 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:52:08.188749 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-de161f8e-987e-432a-ab38-2a799e38edb9 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:52:08.189344 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-de161f8e-987e-432a-ab38-2a799e38edb9 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] [instance: 6526331b-07d9-4ae7-8429-187bf752923d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:52:08.195318 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-de161f8e-987e-432a-ab38-2a799e38edb9 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:08.195758 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-de161f8e-987e-432a-ab38-2a799e38edb9 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:08.196531 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-de161f8e-987e-432a-ab38-2a799e38edb9 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:08.196965 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-de161f8e-987e-432a-ab38-2a799e38edb9 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:08.276542 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-cfaebce4-29bc-4cf3-8215-bcb0a6ede23b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:52:08.277033 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-cfaebce4-29bc-4cf3-8215-bcb0a6ede23b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:52:08.284113 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-cfaebce4-29bc-4cf3-8215-bcb0a6ede23b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:08.284593 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-cfaebce4-29bc-4cf3-8215-bcb0a6ede23b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:08.285358 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-cfaebce4-29bc-4cf3-8215-bcb0a6ede23b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:08.285805 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-cfaebce4-29bc-4cf3-8215-bcb0a6ede23b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:08.299924 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.wsgi [None req-cfaebce4-29bc-4cf3-8215-bcb0a6ede23b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] HTTP exception thrown: Instance 7a6b5e16-473d-4317-8bf7-ee0df07cb224 could not be found. Jun 30 10:52:08.301540 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-cfaebce4-29bc-4cf3-8215-bcb0a6ede23b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Request method failure captured: Jun 30 10:52:08.301540 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: request: DELETE /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 HTTP/1.1 Jun 30 10:52:08.301540 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Accept: application/json Jun 30 10:52:08.301540 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Accept-Encoding: identity Jun 30 10:52:08.301540 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Connection: close Jun 30 10:52:08.301540 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Content-Length: 0 Jun 30 10:52:08.301540 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Content-Type: application/json Jun 30 10:52:08.301540 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Host: 10.222.0.59 Jun 30 10:52:08.301540 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Openstack-System-Scope: None Jun 30 10:52:08.301540 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: User-Agent: python-urllib3/1.26.9 Jun 30 10:52:08.301540 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Auth-Token: gAAAAABivX2O95PG7OwLZsazVloASqbVmipNAFm6f7qcVY4E3WlX41rd0tnm80pMeaWUbOtnrlH_CSuCdrIaArMqD9imR93SBX_VhBipTNZO_mJ8xWvurtwepIWU8hq9tEB4LqdDH4ZWPwmoyVcMweVJSiWAHLPtJvaEwnl-rQ0OwuRu2pw1LVY Jun 30 10:52:08.301540 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Domain-Id: None Jun 30 10:52:08.301540 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Domain-Name: None Jun 30 10:52:08.301540 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Identity-Status: Confirmed Jun 30 10:52:08.301540 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Is-Admin-Project: True Jun 30 10:52:08.301540 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Openstack-Nova-Api-Version: 2.20 Jun 30 10:52:08.301540 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Domain-Id: default Jun 30 10:52:08.301540 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Domain-Name: Default Jun 30 10:52:08.301540 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Id: 2346c16770124c9a86bc6e30880f8bde Jun 30 10:52:08.301540 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2033035787 Jun 30 10:52:08.301540 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Role: member,reader Jun 30 10:52:08.301540 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Roles: member,reader Jun 30 10:52:08.303233 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/2346c16770124c9a86bc6e30880f8bde"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_2346c16770124c9a86bc6e30880f8bde"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2346c16770124c9a86bc6e30880f8bde"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2346c16770124c9a86bc6e30880f8bde"}]}] Jun 30 10:52:08.303233 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2033035787 Jun 30 10:52:08.303233 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant-Id: 2346c16770124c9a86bc6e30880f8bde Jun 30 10:52:08.303233 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2033035787 Jun 30 10:52:08.303233 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User: tempest-AttachVolumeShelveTestJSON-2033035787-project Jun 30 10:52:08.303233 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Domain-Id: default Jun 30 10:52:08.303233 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Domain-Name: Default Jun 30 10:52:08.303233 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Id: f5003e984d58440a80d98405d187eab0 Jun 30 10:52:08.303233 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2033035787-project Jun 30 10:52:08.303233 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: method: > Jun 30 10:52:08.303233 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: exception: Instance 7a6b5e16-473d-4317-8bf7-ee0df07cb224 could not be found. Jun 30 10:52:08.303233 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: action_args: {'id': '7a6b5e16-473d-4317-8bf7-ee0df07cb224'} Jun 30 10:52:08.304008 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:52:08.304008 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:52:08.304008 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 10:52:08.304008 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 10:52:08.304008 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 10:52:08.304008 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 10:52:08.304008 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 10:52:08.304008 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 10:52:08.304008 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 10:52:08.304008 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 10:52:08.304008 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a6b5e16-473d-4317-8bf7-ee0df07cb224 could not be found. Jun 30 10:52:08.304008 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:52:08.304008 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:52:08.304008 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:52:08.304008 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:52:08.304008 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:52:08.304008 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:52:08.304008 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:52:08.304008 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:52:08.304008 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:52:08.305355 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:52:08.305355 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 10:52:08.305355 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 10:52:08.305355 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 10:52:08.305355 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 10:52:08.305355 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 10:52:08.305355 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 10:52:08.305355 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 10:52:08.305355 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:52:08.305355 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a6b5e16-473d-4317-8bf7-ee0df07cb224 could not be found. Jun 30 10:52:08.305355 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:52:08.305355 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:52:08.305355 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:52:08.305355 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:52:08.305355 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:52:08.305355 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:52:08.305355 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:52:08.305355 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:52:08.305355 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a6b5e16-473d-4317-8bf7-ee0df07cb224 could not be found. Jun 30 10:52:08.305355 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:52:08.307007 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-cfaebce4-29bc-4cf3-8215-bcb0a6ede23b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Returning 404 to user: Instance 7a6b5e16-473d-4317-8bf7-ee0df07cb224 could not be found. {{(pid=124203) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:52:08.307007 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-cfaebce4-29bc-4cf3-8215-bcb0a6ede23b tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "DELETE /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224" status: 404 len: 111 microversion: 2.20 time: 0.030404 Jun 30 10:52:08.307007 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 557/1094] 10.222.0.59 () {60 vars in 1279 bytes} [Thu Jun 30 10:52:08 2022] DELETE /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 30 10:52:08.311189 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-214eda9a-6a13-4e2b-9e68-e8f872c642cc tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:52:08.311798 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-214eda9a-6a13-4e2b-9e68-e8f872c642cc tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: 7a6b5e16-473d-4317-8bf7-ee0df07cb224] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:52:08.317669 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-214eda9a-6a13-4e2b-9e68-e8f872c642cc tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:08.318120 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-214eda9a-6a13-4e2b-9e68-e8f872c642cc tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:08.318887 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-214eda9a-6a13-4e2b-9e68-e8f872c642cc tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:08.319401 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-214eda9a-6a13-4e2b-9e68-e8f872c642cc tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:08.333215 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.wsgi [None req-214eda9a-6a13-4e2b-9e68-e8f872c642cc tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] HTTP exception thrown: Instance 7a6b5e16-473d-4317-8bf7-ee0df07cb224 could not be found. Jun 30 10:52:08.334738 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-214eda9a-6a13-4e2b-9e68-e8f872c642cc tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Request method failure captured: Jun 30 10:52:08.334738 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: request: GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 HTTP/1.1 Jun 30 10:52:08.334738 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Accept: application/json Jun 30 10:52:08.334738 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Accept-Encoding: identity Jun 30 10:52:08.334738 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Connection: close Jun 30 10:52:08.334738 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Content-Length: 0 Jun 30 10:52:08.334738 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Content-Type: application/json Jun 30 10:52:08.334738 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Host: 10.222.0.59 Jun 30 10:52:08.334738 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Openstack-System-Scope: None Jun 30 10:52:08.334738 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: User-Agent: python-urllib3/1.26.9 Jun 30 10:52:08.334738 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Auth-Token: gAAAAABivX2O95PG7OwLZsazVloASqbVmipNAFm6f7qcVY4E3WlX41rd0tnm80pMeaWUbOtnrlH_CSuCdrIaArMqD9imR93SBX_VhBipTNZO_mJ8xWvurtwepIWU8hq9tEB4LqdDH4ZWPwmoyVcMweVJSiWAHLPtJvaEwnl-rQ0OwuRu2pw1LVY Jun 30 10:52:08.334738 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Domain-Id: None Jun 30 10:52:08.334738 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Domain-Name: None Jun 30 10:52:08.334738 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Identity-Status: Confirmed Jun 30 10:52:08.334738 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Is-Admin-Project: True Jun 30 10:52:08.334738 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Openstack-Nova-Api-Version: 2.20 Jun 30 10:52:08.334738 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Domain-Id: default Jun 30 10:52:08.334738 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Domain-Name: Default Jun 30 10:52:08.334738 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Id: 2346c16770124c9a86bc6e30880f8bde Jun 30 10:52:08.334738 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2033035787 Jun 30 10:52:08.334738 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Role: member,reader Jun 30 10:52:08.334738 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Roles: member,reader Jun 30 10:52:08.336826 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/2346c16770124c9a86bc6e30880f8bde"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_2346c16770124c9a86bc6e30880f8bde"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2346c16770124c9a86bc6e30880f8bde"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2346c16770124c9a86bc6e30880f8bde"}]}] Jun 30 10:52:08.336826 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2033035787 Jun 30 10:52:08.336826 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant-Id: 2346c16770124c9a86bc6e30880f8bde Jun 30 10:52:08.336826 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2033035787 Jun 30 10:52:08.336826 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User: tempest-AttachVolumeShelveTestJSON-2033035787-project Jun 30 10:52:08.336826 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Domain-Id: default Jun 30 10:52:08.336826 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Domain-Name: Default Jun 30 10:52:08.336826 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Id: f5003e984d58440a80d98405d187eab0 Jun 30 10:52:08.336826 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2033035787-project Jun 30 10:52:08.336826 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: method: > Jun 30 10:52:08.336826 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: exception: Instance 7a6b5e16-473d-4317-8bf7-ee0df07cb224 could not be found. Jun 30 10:52:08.336826 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: action_args: {'id': '7a6b5e16-473d-4317-8bf7-ee0df07cb224'} Jun 30 10:52:08.337558 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:52:08.337558 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:52:08.337558 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 10:52:08.337558 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 10:52:08.337558 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 10:52:08.337558 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 10:52:08.337558 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 10:52:08.337558 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 10:52:08.337558 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 10:52:08.337558 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 10:52:08.337558 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a6b5e16-473d-4317-8bf7-ee0df07cb224 could not be found. Jun 30 10:52:08.337558 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:52:08.337558 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:52:08.337558 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:52:08.337558 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:52:08.337558 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:52:08.337558 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:52:08.337558 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:52:08.337558 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:52:08.337558 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:52:08.338746 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:52:08.338746 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 10:52:08.338746 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 10:52:08.338746 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 10:52:08.338746 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 10:52:08.338746 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 10:52:08.338746 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:52:08.338746 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a6b5e16-473d-4317-8bf7-ee0df07cb224 could not be found. Jun 30 10:52:08.338746 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:52:08.338746 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:52:08.338746 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:52:08.338746 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:52:08.338746 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:52:08.338746 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:52:08.338746 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:52:08.338746 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:52:08.338746 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a6b5e16-473d-4317-8bf7-ee0df07cb224 could not be found. Jun 30 10:52:08.338746 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:52:08.339811 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-214eda9a-6a13-4e2b-9e68-e8f872c642cc tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Returning 404 to user: Instance 7a6b5e16-473d-4317-8bf7-ee0df07cb224 could not be found. {{(pid=124203) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:52:08.339811 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-214eda9a-6a13-4e2b-9e68-e8f872c642cc tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224" status: 404 len: 111 microversion: 2.20 time: 0.028631 Jun 30 10:52:08.339811 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 558/1095] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:52:08 2022] GET /compute/v2.1/servers/7a6b5e16-473d-4317-8bf7-ee0df07cb224 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 30 10:52:08.342820 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-de161f8e-987e-432a-ab38-2a799e38edb9 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a24491b2e4545e289fa4f1cff4f30d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ab649bf434f78b83122111ec19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:52:08.351098 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-de161f8e-987e-432a-ab38-2a799e38edb9 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] 10.222.0.59 "GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d" status: 200 len: 1756 microversion: 2.1 time: 0.166702 Jun 30 10:52:08.351674 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 538/1096] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:52:08 2022] GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:52:09.368457 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-cba3401d-2f6f-411f-a89a-a3a24548cec1 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:52:09.369096 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-cba3401d-2f6f-411f-a89a-a3a24548cec1 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] [instance: 6526331b-07d9-4ae7-8429-187bf752923d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:52:09.375891 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-cba3401d-2f6f-411f-a89a-a3a24548cec1 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:09.376345 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-cba3401d-2f6f-411f-a89a-a3a24548cec1 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:09.377148 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-cba3401d-2f6f-411f-a89a-a3a24548cec1 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:09.377588 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-cba3401d-2f6f-411f-a89a-a3a24548cec1 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:09.476109 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-cea2e51e-3a3e-4c86-92ae-49dd3a40eb19 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:52:09.476702 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-cea2e51e-3a3e-4c86-92ae-49dd3a40eb19 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:52:09.483516 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-cea2e51e-3a3e-4c86-92ae-49dd3a40eb19 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:09.484047 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-cea2e51e-3a3e-4c86-92ae-49dd3a40eb19 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:09.485176 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-cea2e51e-3a3e-4c86-92ae-49dd3a40eb19 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:09.485672 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-cea2e51e-3a3e-4c86-92ae-49dd3a40eb19 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:09.500081 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.wsgi [None req-cea2e51e-3a3e-4c86-92ae-49dd3a40eb19 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] HTTP exception thrown: Instance af0d59b6-8e95-4947-803a-c1d952e218c8 could not be found. Jun 30 10:52:09.502029 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-cea2e51e-3a3e-4c86-92ae-49dd3a40eb19 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Request method failure captured: Jun 30 10:52:09.502029 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: request: DELETE /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 HTTP/1.1 Jun 30 10:52:09.502029 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Accept: application/json Jun 30 10:52:09.502029 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Accept-Encoding: identity Jun 30 10:52:09.502029 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Connection: close Jun 30 10:52:09.502029 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Content-Length: 0 Jun 30 10:52:09.502029 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Content-Type: application/json Jun 30 10:52:09.502029 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Host: 10.222.0.59 Jun 30 10:52:09.502029 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Openstack-System-Scope: None Jun 30 10:52:09.502029 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: User-Agent: python-urllib3/1.26.9 Jun 30 10:52:09.502029 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Auth-Token: gAAAAABivX2O95PG7OwLZsazVloASqbVmipNAFm6f7qcVY4E3WlX41rd0tnm80pMeaWUbOtnrlH_CSuCdrIaArMqD9imR93SBX_VhBipTNZO_mJ8xWvurtwepIWU8hq9tEB4LqdDH4ZWPwmoyVcMweVJSiWAHLPtJvaEwnl-rQ0OwuRu2pw1LVY Jun 30 10:52:09.502029 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Domain-Id: None Jun 30 10:52:09.502029 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Domain-Name: None Jun 30 10:52:09.502029 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Identity-Status: Confirmed Jun 30 10:52:09.502029 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Is-Admin-Project: True Jun 30 10:52:09.502029 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Openstack-Nova-Api-Version: 2.20 Jun 30 10:52:09.502029 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Domain-Id: default Jun 30 10:52:09.502029 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Domain-Name: Default Jun 30 10:52:09.502029 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Id: 2346c16770124c9a86bc6e30880f8bde Jun 30 10:52:09.502029 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2033035787 Jun 30 10:52:09.502029 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Role: member,reader Jun 30 10:52:09.502029 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Roles: member,reader Jun 30 10:52:09.503391 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/2346c16770124c9a86bc6e30880f8bde"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_2346c16770124c9a86bc6e30880f8bde"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2346c16770124c9a86bc6e30880f8bde"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2346c16770124c9a86bc6e30880f8bde"}]}] Jun 30 10:52:09.503391 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2033035787 Jun 30 10:52:09.503391 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant-Id: 2346c16770124c9a86bc6e30880f8bde Jun 30 10:52:09.503391 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2033035787 Jun 30 10:52:09.503391 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User: tempest-AttachVolumeShelveTestJSON-2033035787-project Jun 30 10:52:09.503391 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Domain-Id: default Jun 30 10:52:09.503391 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Domain-Name: Default Jun 30 10:52:09.503391 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Id: f5003e984d58440a80d98405d187eab0 Jun 30 10:52:09.503391 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2033035787-project Jun 30 10:52:09.503391 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: method: > Jun 30 10:52:09.503391 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: exception: Instance af0d59b6-8e95-4947-803a-c1d952e218c8 could not be found. Jun 30 10:52:09.503391 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: action_args: {'id': 'af0d59b6-8e95-4947-803a-c1d952e218c8'} Jun 30 10:52:09.504181 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:52:09.504181 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:52:09.504181 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 10:52:09.504181 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 10:52:09.504181 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 10:52:09.504181 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 10:52:09.504181 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 10:52:09.504181 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 10:52:09.504181 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 10:52:09.504181 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 10:52:09.504181 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af0d59b6-8e95-4947-803a-c1d952e218c8 could not be found. Jun 30 10:52:09.504181 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:52:09.504181 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:52:09.504181 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:52:09.504181 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:52:09.504181 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:52:09.504181 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:52:09.504181 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:52:09.504181 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:52:09.504181 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:52:09.505426 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:52:09.505426 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 10:52:09.505426 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 10:52:09.505426 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 10:52:09.505426 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 10:52:09.505426 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 10:52:09.505426 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 10:52:09.505426 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 10:52:09.505426 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:52:09.505426 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af0d59b6-8e95-4947-803a-c1d952e218c8 could not be found. Jun 30 10:52:09.505426 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:52:09.505426 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:52:09.505426 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:52:09.505426 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:52:09.505426 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:52:09.505426 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:52:09.505426 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:52:09.505426 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:52:09.505426 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af0d59b6-8e95-4947-803a-c1d952e218c8 could not be found. Jun 30 10:52:09.505426 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:52:09.508138 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-cea2e51e-3a3e-4c86-92ae-49dd3a40eb19 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Returning 404 to user: Instance af0d59b6-8e95-4947-803a-c1d952e218c8 could not be found. {{(pid=124204) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:52:09.509237 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-cea2e51e-3a3e-4c86-92ae-49dd3a40eb19 tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "DELETE /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 404 len: 111 microversion: 2.20 time: 0.037010 Jun 30 10:52:09.509887 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 539/1097] 10.222.0.59 () {60 vars in 1279 bytes} [Thu Jun 30 10:52:09 2022] DELETE /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 30 10:52:09.518273 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-0ef3f400-34dd-4161-aaaf-7605c6c49eed tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:52:09.519115 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-0ef3f400-34dd-4161-aaaf-7605c6c49eed tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] [instance: af0d59b6-8e95-4947-803a-c1d952e218c8] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:52:09.525425 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-0ef3f400-34dd-4161-aaaf-7605c6c49eed tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:09.526056 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-0ef3f400-34dd-4161-aaaf-7605c6c49eed tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:09.526814 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-0ef3f400-34dd-4161-aaaf-7605c6c49eed tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:09.527471 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-0ef3f400-34dd-4161-aaaf-7605c6c49eed tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:09.541017 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.wsgi [None req-0ef3f400-34dd-4161-aaaf-7605c6c49eed tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] HTTP exception thrown: Instance af0d59b6-8e95-4947-803a-c1d952e218c8 could not be found. Jun 30 10:52:09.542538 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-0ef3f400-34dd-4161-aaaf-7605c6c49eed tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Request method failure captured: Jun 30 10:52:09.542538 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: request: GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 HTTP/1.1 Jun 30 10:52:09.542538 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Accept: application/json Jun 30 10:52:09.542538 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Accept-Encoding: identity Jun 30 10:52:09.542538 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Connection: close Jun 30 10:52:09.542538 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Content-Length: 0 Jun 30 10:52:09.542538 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Content-Type: application/json Jun 30 10:52:09.542538 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Host: 10.222.0.59 Jun 30 10:52:09.542538 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Openstack-System-Scope: None Jun 30 10:52:09.542538 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: User-Agent: python-urllib3/1.26.9 Jun 30 10:52:09.542538 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Auth-Token: gAAAAABivX2O95PG7OwLZsazVloASqbVmipNAFm6f7qcVY4E3WlX41rd0tnm80pMeaWUbOtnrlH_CSuCdrIaArMqD9imR93SBX_VhBipTNZO_mJ8xWvurtwepIWU8hq9tEB4LqdDH4ZWPwmoyVcMweVJSiWAHLPtJvaEwnl-rQ0OwuRu2pw1LVY Jun 30 10:52:09.542538 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Domain-Id: None Jun 30 10:52:09.542538 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Domain-Name: None Jun 30 10:52:09.542538 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Identity-Status: Confirmed Jun 30 10:52:09.542538 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Is-Admin-Project: True Jun 30 10:52:09.542538 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Openstack-Nova-Api-Version: 2.20 Jun 30 10:52:09.542538 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Domain-Id: default Jun 30 10:52:09.542538 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Domain-Name: Default Jun 30 10:52:09.542538 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Id: 2346c16770124c9a86bc6e30880f8bde Jun 30 10:52:09.542538 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2033035787 Jun 30 10:52:09.542538 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Role: member,reader Jun 30 10:52:09.542538 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Roles: member,reader Jun 30 10:52:09.543969 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/2346c16770124c9a86bc6e30880f8bde"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_2346c16770124c9a86bc6e30880f8bde"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2346c16770124c9a86bc6e30880f8bde"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2346c16770124c9a86bc6e30880f8bde"}]}] Jun 30 10:52:09.543969 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2033035787 Jun 30 10:52:09.543969 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant-Id: 2346c16770124c9a86bc6e30880f8bde Jun 30 10:52:09.543969 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2033035787 Jun 30 10:52:09.543969 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User: tempest-AttachVolumeShelveTestJSON-2033035787-project Jun 30 10:52:09.543969 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Domain-Id: default Jun 30 10:52:09.543969 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Domain-Name: Default Jun 30 10:52:09.543969 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Id: f5003e984d58440a80d98405d187eab0 Jun 30 10:52:09.543969 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2033035787-project Jun 30 10:52:09.543969 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: method: > Jun 30 10:52:09.543969 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: exception: Instance af0d59b6-8e95-4947-803a-c1d952e218c8 could not be found. Jun 30 10:52:09.543969 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: action_args: {'id': 'af0d59b6-8e95-4947-803a-c1d952e218c8'} Jun 30 10:52:09.544742 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:52:09.544742 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:52:09.544742 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 10:52:09.544742 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 10:52:09.544742 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 10:52:09.544742 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 10:52:09.544742 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 10:52:09.544742 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 10:52:09.544742 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 10:52:09.544742 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 10:52:09.544742 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af0d59b6-8e95-4947-803a-c1d952e218c8 could not be found. Jun 30 10:52:09.544742 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:52:09.544742 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:52:09.544742 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:52:09.544742 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:52:09.544742 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:52:09.544742 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:52:09.544742 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:52:09.544742 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:52:09.544742 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:52:09.546657 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:52:09.546657 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 10:52:09.546657 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 10:52:09.546657 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 10:52:09.546657 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 10:52:09.546657 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 10:52:09.546657 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:52:09.546657 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af0d59b6-8e95-4947-803a-c1d952e218c8 could not be found. Jun 30 10:52:09.546657 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:52:09.546657 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:52:09.546657 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:52:09.546657 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:52:09.546657 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:52:09.546657 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:52:09.546657 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:52:09.546657 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:52:09.546657 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af0d59b6-8e95-4947-803a-c1d952e218c8 could not be found. Jun 30 10:52:09.546657 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:52:09.547718 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-cba3401d-2f6f-411f-a89a-a3a24548cec1 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a24491b2e4545e289fa4f1cff4f30d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ab649bf434f78b83122111ec19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:52:09.547824 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-0ef3f400-34dd-4161-aaaf-7605c6c49eed tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] Returning 404 to user: Instance af0d59b6-8e95-4947-803a-c1d952e218c8 could not be found. {{(pid=124204) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:52:09.547824 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-0ef3f400-34dd-4161-aaaf-7605c6c49eed tempest-AttachVolumeShelveTestJSON-2033035787 tempest-AttachVolumeShelveTestJSON-2033035787-project] 10.222.0.59 "GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8" status: 404 len: 111 microversion: 2.20 time: 0.033142 Jun 30 10:52:09.548881 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 540/1098] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 30 10:52:09 2022] GET /compute/v2.1/servers/af0d59b6-8e95-4947-803a-c1d952e218c8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 30 10:52:09.552115 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-cba3401d-2f6f-411f-a89a-a3a24548cec1 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] 10.222.0.59 "GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d" status: 200 len: 1756 microversion: 2.1 time: 0.187531 Jun 30 10:52:09.552701 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 559/1099] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:52:09 2022] GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d => generated 1756 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:52:10.571911 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-9a215208-fb30-43a0-91d7-f1587c4c3257 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:52:10.572650 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-9a215208-fb30-43a0-91d7-f1587c4c3257 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] [instance: 6526331b-07d9-4ae7-8429-187bf752923d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:52:10.581302 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-9a215208-fb30-43a0-91d7-f1587c4c3257 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:10.582199 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-9a215208-fb30-43a0-91d7-f1587c4c3257 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:10.583145 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-9a215208-fb30-43a0-91d7-f1587c4c3257 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:10.584869 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-9a215208-fb30-43a0-91d7-f1587c4c3257 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:10.765934 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-9a215208-fb30-43a0-91d7-f1587c4c3257 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a24491b2e4545e289fa4f1cff4f30d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ab649bf434f78b83122111ec19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:52:10.797777 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-9a215208-fb30-43a0-91d7-f1587c4c3257 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] 10.222.0.59 "GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d" status: 200 len: 1756 microversion: 2.1 time: 0.232016 Jun 30 10:52:10.798746 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 541/1100] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:52:10 2022] GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d => generated 1756 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:52:11.816050 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-504ff4c7-db27-4847-8783-5d7e8fb49400 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:52:11.816628 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-504ff4c7-db27-4847-8783-5d7e8fb49400 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] [instance: 6526331b-07d9-4ae7-8429-187bf752923d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:52:11.822989 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-504ff4c7-db27-4847-8783-5d7e8fb49400 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:11.823440 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-504ff4c7-db27-4847-8783-5d7e8fb49400 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:11.824220 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-504ff4c7-db27-4847-8783-5d7e8fb49400 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:11.824691 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-504ff4c7-db27-4847-8783-5d7e8fb49400 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:11.991314 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-504ff4c7-db27-4847-8783-5d7e8fb49400 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a24491b2e4545e289fa4f1cff4f30d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ab649bf434f78b83122111ec19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:52:12.008061 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-504ff4c7-db27-4847-8783-5d7e8fb49400 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] 10.222.0.59 "GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d" status: 200 len: 1756 microversion: 2.1 time: 0.195604 Jun 30 10:52:12.009002 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 560/1101] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:52:11 2022] GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d => generated 1756 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:52:13.026107 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-c6ab2b6a-f3f8-48b1-910f-e08fc50117b9 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:52:13.026719 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-c6ab2b6a-f3f8-48b1-910f-e08fc50117b9 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] [instance: 6526331b-07d9-4ae7-8429-187bf752923d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:52:13.033247 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c6ab2b6a-f3f8-48b1-910f-e08fc50117b9 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:13.033690 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c6ab2b6a-f3f8-48b1-910f-e08fc50117b9 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:13.034447 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c6ab2b6a-f3f8-48b1-910f-e08fc50117b9 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:13.034876 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c6ab2b6a-f3f8-48b1-910f-e08fc50117b9 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:13.184437 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-c6ab2b6a-f3f8-48b1-910f-e08fc50117b9 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a24491b2e4545e289fa4f1cff4f30d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ab649bf434f78b83122111ec19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:52:13.193072 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-c6ab2b6a-f3f8-48b1-910f-e08fc50117b9 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] 10.222.0.59 "GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d" status: 200 len: 1756 microversion: 2.1 time: 0.170893 Jun 30 10:52:13.193643 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 542/1102] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:52:13 2022] GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:52:14.212035 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-c2e01cae-98a4-4dcb-8020-d70659cf4779 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:52:14.212035 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-c2e01cae-98a4-4dcb-8020-d70659cf4779 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] [instance: 6526331b-07d9-4ae7-8429-187bf752923d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:52:14.217880 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c2e01cae-98a4-4dcb-8020-d70659cf4779 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:14.218330 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c2e01cae-98a4-4dcb-8020-d70659cf4779 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:14.219099 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c2e01cae-98a4-4dcb-8020-d70659cf4779 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:14.219534 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c2e01cae-98a4-4dcb-8020-d70659cf4779 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:14.376716 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-c2e01cae-98a4-4dcb-8020-d70659cf4779 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a24491b2e4545e289fa4f1cff4f30d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ab649bf434f78b83122111ec19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:52:14.384618 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-c2e01cae-98a4-4dcb-8020-d70659cf4779 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] 10.222.0.59 "GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d" status: 200 len: 1756 microversion: 2.1 time: 0.178107 Jun 30 10:52:14.385176 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 561/1103] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:52:14 2022] GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d => generated 1756 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:52:15.402823 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-4ae164bc-a542-4a1a-a99d-b80602898c21 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:52:15.403593 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-4ae164bc-a542-4a1a-a99d-b80602898c21 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] [instance: 6526331b-07d9-4ae7-8429-187bf752923d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:52:15.421011 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-4ae164bc-a542-4a1a-a99d-b80602898c21 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:15.421974 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-4ae164bc-a542-4a1a-a99d-b80602898c21 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:15.422770 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-4ae164bc-a542-4a1a-a99d-b80602898c21 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:15.423272 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-4ae164bc-a542-4a1a-a99d-b80602898c21 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:15.601213 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-4ae164bc-a542-4a1a-a99d-b80602898c21 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a24491b2e4545e289fa4f1cff4f30d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ab649bf434f78b83122111ec19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:52:15.609980 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-4ae164bc-a542-4a1a-a99d-b80602898c21 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] 10.222.0.59 "GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d" status: 200 len: 1759 microversion: 2.1 time: 0.211356 Jun 30 10:52:15.622362 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 543/1104] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:52:15 2022] GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d => generated 1759 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:52:16.754270 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-2c93b6cd-e69e-42b7-b81a-a7f0259f39f9 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:52:16.754887 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-2c93b6cd-e69e-42b7-b81a-a7f0259f39f9 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 71a25d37-33ee-4e2f-a2b3-474b211268c4] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:52:16.766530 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-2c93b6cd-e69e-42b7-b81a-a7f0259f39f9 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:16.766874 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-2c93b6cd-e69e-42b7-b81a-a7f0259f39f9 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:16.767667 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-2c93b6cd-e69e-42b7-b81a-a7f0259f39f9 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:16.768108 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-2c93b6cd-e69e-42b7-b81a-a7f0259f39f9 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:16.801967 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-2c93b6cd-e69e-42b7-b81a-a7f0259f39f9 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/71a25d37-33ee-4e2f-a2b3-474b211268c4/ips" status: 200 len: 151 microversion: 2.1 time: 0.051183 Jun 30 10:52:16.803575 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 562/1105] 10.222.0.59 () {58 vars in 1247 bytes} [Thu Jun 30 10:52:16 2022] GET /compute/v2.1/servers/71a25d37-33ee-4e2f-a2b3-474b211268c4/ips => generated 151 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:52:18.179439 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-9a3797cb-8508-4c1d-a77c-0d2d1f46bd93 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f9bb63cd-c3d0-4652-afaa-c1ea4d6a0d62"}} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:52:18.180527 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-9a3797cb-8508-4c1d-a77c-0d2d1f46bd93 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 71a25d37-33ee-4e2f-a2b3-474b211268c4] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:52:18.187995 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-9a3797cb-8508-4c1d-a77c-0d2d1f46bd93 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:18.188446 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-9a3797cb-8508-4c1d-a77c-0d2d1f46bd93 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:18.189257 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-9a3797cb-8508-4c1d-a77c-0d2d1f46bd93 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:18.189700 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-9a3797cb-8508-4c1d-a77c-0d2d1f46bd93 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:18.459653 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-9a3797cb-8508-4c1d-a77c-0d2d1f46bd93 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "POST /compute/v2.1/servers/71a25d37-33ee-4e2f-a2b3-474b211268c4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.284320 Jun 30 10:52:18.460460 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 544/1106] 10.222.0.59 () {60 vars in 1322 bytes} [Thu Jun 30 10:52:18 2022] POST /compute/v2.1/servers/71a25d37-33ee-4e2f-a2b3-474b211268c4/os-volume_attachments => generated 194 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:52:26.142849 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-25b67e6e-916f-4e63-b45e-ddd9a3bb6a0c tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:52:26.143903 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-25b67e6e-916f-4e63-b45e-ddd9a3bb6a0c tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 71a25d37-33ee-4e2f-a2b3-474b211268c4] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:52:26.151842 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-25b67e6e-916f-4e63-b45e-ddd9a3bb6a0c tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:26.152286 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-25b67e6e-916f-4e63-b45e-ddd9a3bb6a0c tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:26.153266 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-25b67e6e-916f-4e63-b45e-ddd9a3bb6a0c tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:26.153907 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-25b67e6e-916f-4e63-b45e-ddd9a3bb6a0c tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:26.247969 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.objects.instance [None req-25b67e6e-916f-4e63-b45e-ddd9a3bb6a0c tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lazy-loading 'services' on Instance uuid 71a25d37-33ee-4e2f-a2b3-474b211268c4 {{(pid=124203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 10:52:26.326396 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-25b67e6e-916f-4e63-b45e-ddd9a3bb6a0c tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "DELETE /compute/v2.1/servers/71a25d37-33ee-4e2f-a2b3-474b211268c4/os-volume_attachments/f9bb63cd-c3d0-4652-afaa-c1ea4d6a0d62" status: 202 len: 0 microversion: 2.1 time: 0.187881 Jun 30 10:52:26.327301 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 563/1107] 10.222.0.59 () {58 vars in 1415 bytes} [Thu Jun 30 10:52:26 2022] DELETE /compute/v2.1/servers/71a25d37-33ee-4e2f-a2b3-474b211268c4/os-volume_attachments/f9bb63cd-c3d0-4652-afaa-c1ea4d6a0d62 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 10:52:26.336320 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-cc2d0023-0db2-4ec6-b462-f7db0d3c32cb tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:52:26.337474 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-cc2d0023-0db2-4ec6-b462-f7db0d3c32cb tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 71a25d37-33ee-4e2f-a2b3-474b211268c4] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:52:26.348776 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-cc2d0023-0db2-4ec6-b462-f7db0d3c32cb tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:26.349508 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-cc2d0023-0db2-4ec6-b462-f7db0d3c32cb tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:26.350521 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-cc2d0023-0db2-4ec6-b462-f7db0d3c32cb tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:26.351152 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-cc2d0023-0db2-4ec6-b462-f7db0d3c32cb tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:26.370801 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:26.401108 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-cc2d0023-0db2-4ec6-b462-f7db0d3c32cb tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/71a25d37-33ee-4e2f-a2b3-474b211268c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069051 Jun 30 10:52:26.406116 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 545/1108] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 30 10:52:26 2022] GET /compute/v2.1/servers/71a25d37-33ee-4e2f-a2b3-474b211268c4/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:52:27.414815 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-3c266725-9401-43d0-a551-7decd1dd5a76 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:52:27.416422 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-3c266725-9401-43d0-a551-7decd1dd5a76 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 71a25d37-33ee-4e2f-a2b3-474b211268c4] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:52:27.424098 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-3c266725-9401-43d0-a551-7decd1dd5a76 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:27.424601 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-3c266725-9401-43d0-a551-7decd1dd5a76 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:27.425596 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-3c266725-9401-43d0-a551-7decd1dd5a76 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:27.426044 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-3c266725-9401-43d0-a551-7decd1dd5a76 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:27.460115 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-3c266725-9401-43d0-a551-7decd1dd5a76 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/71a25d37-33ee-4e2f-a2b3-474b211268c4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050205 Jun 30 10:52:27.461245 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 564/1109] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 30 10:52:27 2022] GET /compute/v2.1/servers/71a25d37-33ee-4e2f-a2b3-474b211268c4/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 30 10:52:27.526696 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-e0850c6c-43de-4761-8be0-45c0dda8184f tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:52:27.527273 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-e0850c6c-43de-4761-8be0-45c0dda8184f tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 71a25d37-33ee-4e2f-a2b3-474b211268c4] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:52:27.535951 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-e0850c6c-43de-4761-8be0-45c0dda8184f tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:27.548942 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-e0850c6c-43de-4761-8be0-45c0dda8184f tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:27.550042 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-e0850c6c-43de-4761-8be0-45c0dda8184f tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:27.550503 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-e0850c6c-43de-4761-8be0-45c0dda8184f tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:27.578589 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-e0850c6c-43de-4761-8be0-45c0dda8184f tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 71a25d37-33ee-4e2f-a2b3-474b211268c4] Going to try to terminate instance {{(pid=124204) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 10:52:27.715628 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-e0850c6c-43de-4761-8be0-45c0dda8184f tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "DELETE /compute/v2.1/servers/71a25d37-33ee-4e2f-a2b3-474b211268c4" status: 204 len: 0 microversion: 2.1 time: 0.192767 Jun 30 10:52:27.717204 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 546/1110] 10.222.0.59 () {58 vars in 1238 bytes} [Thu Jun 30 10:52:27 2022] DELETE /compute/v2.1/servers/71a25d37-33ee-4e2f-a2b3-474b211268c4 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 10:52:27.729988 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-419479d3-c0d0-430c-b8f0-847d121ee512 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:52:27.730672 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-419479d3-c0d0-430c-b8f0-847d121ee512 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 71a25d37-33ee-4e2f-a2b3-474b211268c4] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:52:27.739488 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-419479d3-c0d0-430c-b8f0-847d121ee512 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:27.740399 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-419479d3-c0d0-430c-b8f0-847d121ee512 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:27.741397 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-419479d3-c0d0-430c-b8f0-847d121ee512 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:27.742000 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-419479d3-c0d0-430c-b8f0-847d121ee512 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:28.083475 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-419479d3-c0d0-430c-b8f0-847d121ee512 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:52:28.094756 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-419479d3-c0d0-430c-b8f0-847d121ee512 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/71a25d37-33ee-4e2f-a2b3-474b211268c4" status: 200 len: 1683 microversion: 2.1 time: 0.373060 Jun 30 10:52:28.104956 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 565/1111] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:52:27 2022] GET /compute/v2.1/servers/71a25d37-33ee-4e2f-a2b3-474b211268c4 => generated 1683 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:52:29.115816 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-d97b668f-f8b6-4387-b585-0cf62a8c17ba tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:52:29.117407 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-d97b668f-f8b6-4387-b585-0cf62a8c17ba tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 71a25d37-33ee-4e2f-a2b3-474b211268c4] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:52:29.120185 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:29.126436 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d97b668f-f8b6-4387-b585-0cf62a8c17ba tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:29.127243 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d97b668f-f8b6-4387-b585-0cf62a8c17ba tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:29.128577 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d97b668f-f8b6-4387-b585-0cf62a8c17ba tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:29.129368 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d97b668f-f8b6-4387-b585-0cf62a8c17ba tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:29.358818 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-d97b668f-f8b6-4387-b585-0cf62a8c17ba tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:52:29.367421 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-d97b668f-f8b6-4387-b585-0cf62a8c17ba tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/71a25d37-33ee-4e2f-a2b3-474b211268c4" status: 200 len: 1683 microversion: 2.1 time: 0.259082 Jun 30 10:52:29.379147 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 547/1112] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:52:29 2022] GET /compute/v2.1/servers/71a25d37-33ee-4e2f-a2b3-474b211268c4 => generated 1683 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:52:30.385911 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-48c5a783-a62e-402c-beca-4cf94ba4c943 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:52:30.387357 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-48c5a783-a62e-402c-beca-4cf94ba4c943 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 71a25d37-33ee-4e2f-a2b3-474b211268c4] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:52:30.391633 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_api:SELECT=35 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:30.406276 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-48c5a783-a62e-402c-beca-4cf94ba4c943 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:30.407038 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-48c5a783-a62e-402c-beca-4cf94ba4c943 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:30.408408 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-48c5a783-a62e-402c-beca-4cf94ba4c943 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:30.409061 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-48c5a783-a62e-402c-beca-4cf94ba4c943 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:30.416022 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:30.720068 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-48c5a783-a62e-402c-beca-4cf94ba4c943 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:52:30.728850 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-48c5a783-a62e-402c-beca-4cf94ba4c943 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/71a25d37-33ee-4e2f-a2b3-474b211268c4" status: 200 len: 1683 microversion: 2.1 time: 0.346690 Jun 30 10:52:30.730124 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 566/1113] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:52:30 2022] GET /compute/v2.1/servers/71a25d37-33ee-4e2f-a2b3-474b211268c4 => generated 1683 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:52:31.748271 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-38899507-7b61-4814-9060-9fa947606c0f tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:52:31.749834 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-38899507-7b61-4814-9060-9fa947606c0f tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 71a25d37-33ee-4e2f-a2b3-474b211268c4] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:52:31.768278 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-38899507-7b61-4814-9060-9fa947606c0f tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:31.768841 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-38899507-7b61-4814-9060-9fa947606c0f tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:31.770389 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-38899507-7b61-4814-9060-9fa947606c0f tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:31.771402 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-38899507-7b61-4814-9060-9fa947606c0f tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:31.884050 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-38899507-7b61-4814-9060-9fa947606c0f tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a194d68415422fbc6ca75a8dbccf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d69e5041341488aafc3e6d26d491c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:52:31.898423 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [req-f13ddd6b-b720-40ee-90ee-c1abaa820d15 req-c9b9fd3d-a43c-43e4-9a91-a8c2a027f30f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71a25d37-33ee-4e2f-a2b3-474b211268c4", "name": "network-vif-deleted", "tag": "069370ba-0ec4-4f19-914f-312ecbfdf92b"}]} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:52:31.899853 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-38899507-7b61-4814-9060-9fa947606c0f tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/71a25d37-33ee-4e2f-a2b3-474b211268c4" status: 200 len: 1616 microversion: 2.1 time: 0.156528 Jun 30 10:52:31.913219 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 548/1114] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:52:31 2022] GET /compute/v2.1/servers/71a25d37-33ee-4e2f-a2b3-474b211268c4 => generated 1616 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:52:31.973470 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-f13ddd6b-b720-40ee-90ee-c1abaa820d15 req-c9b9fd3d-a43c-43e4-9a91-a8c2a027f30f service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:31.973938 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-f13ddd6b-b720-40ee-90ee-c1abaa820d15 req-c9b9fd3d-a43c-43e4-9a91-a8c2a027f30f service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:32.016621 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.compute.server_external_events [req-f13ddd6b-b720-40ee-90ee-c1abaa820d15 req-c9b9fd3d-a43c-43e4-9a91-a8c2a027f30f service nova] Creating event network-vif-deleted:069370ba-0ec4-4f19-914f-312ecbfdf92b for instance 71a25d37-33ee-4e2f-a2b3-474b211268c4 on hv-cinder-82282 Jun 30 10:52:32.026308 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [req-f13ddd6b-b720-40ee-90ee-c1abaa820d15 req-c9b9fd3d-a43c-43e4-9a91-a8c2a027f30f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133481 Jun 30 10:52:32.030781 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 567/1115] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:52:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 10:52:32.918213 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-4b9b7777-d165-4425-9f01-1827e842aaa9 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:52:32.920339 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-4b9b7777-d165-4425-9f01-1827e842aaa9 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 71a25d37-33ee-4e2f-a2b3-474b211268c4] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:52:32.928011 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-4b9b7777-d165-4425-9f01-1827e842aaa9 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:32.928471 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-4b9b7777-d165-4425-9f01-1827e842aaa9 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:32.930141 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-4b9b7777-d165-4425-9f01-1827e842aaa9 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:32.930675 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-4b9b7777-d165-4425-9f01-1827e842aaa9 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:32.977635 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.wsgi [None req-4b9b7777-d165-4425-9f01-1827e842aaa9 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] HTTP exception thrown: Instance 71a25d37-33ee-4e2f-a2b3-474b211268c4 could not be found. Jun 30 10:52:32.980458 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-4b9b7777-d165-4425-9f01-1827e842aaa9 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Request method failure captured: Jun 30 10:52:32.980458 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: request: GET /compute/v2.1/servers/71a25d37-33ee-4e2f-a2b3-474b211268c4 HTTP/1.1 Jun 30 10:52:32.980458 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Accept: application/json Jun 30 10:52:32.980458 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Accept-Encoding: identity Jun 30 10:52:32.980458 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Connection: close Jun 30 10:52:32.980458 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Content-Length: 0 Jun 30 10:52:32.980458 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Content-Type: application/json Jun 30 10:52:32.980458 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Host: 10.222.0.59 Jun 30 10:52:32.980458 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Openstack-System-Scope: None Jun 30 10:52:32.980458 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: User-Agent: python-urllib3/1.26.9 Jun 30 10:52:32.980458 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Auth-Token: gAAAAABivX2SDXLzZddWIKNVN1nlKFPwtYJlUUF8PxnvIHmdlvz3CWxsmmlutMh4nwIcp8e29jVTyW0L2PeVImDMIlnOZ-7kokNBpPBYwuv_h-8Q51jKjjG2cB0Se9mEglmc0BxaTnOJa9GnDeBKjS31T1Z6kscoN_FtN_Ly_k2htqmUscjC_wQ Jun 30 10:52:32.980458 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Domain-Id: None Jun 30 10:52:32.980458 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Domain-Name: None Jun 30 10:52:32.980458 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Identity-Status: Confirmed Jun 30 10:52:32.980458 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Is-Admin-Project: True Jun 30 10:52:32.980458 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Domain-Id: default Jun 30 10:52:32.980458 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Domain-Name: Default Jun 30 10:52:32.980458 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Id: 848d69e5041341488aafc3e6d26d491c Jun 30 10:52:32.980458 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Name: tempest-AttachVolumeNegativeTest-1311706498 Jun 30 10:52:32.980458 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Role: member,reader Jun 30 10:52:32.980458 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Roles: member,reader Jun 30 10:52:32.981911 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/848d69e5041341488aafc3e6d26d491c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_848d69e5041341488aafc3e6d26d491c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/848d69e5041341488aafc3e6d26d491c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/848d69e5041341488aafc3e6d26d491c"}]}] Jun 30 10:52:32.981911 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant: tempest-AttachVolumeNegativeTest-1311706498 Jun 30 10:52:32.981911 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant-Id: 848d69e5041341488aafc3e6d26d491c Jun 30 10:52:32.981911 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1311706498 Jun 30 10:52:32.981911 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User: tempest-AttachVolumeNegativeTest-1311706498-project Jun 30 10:52:32.981911 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Domain-Id: default Jun 30 10:52:32.981911 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Domain-Name: Default Jun 30 10:52:32.981911 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Id: d6a194d68415422fbc6ca75a8dbccf22 Jun 30 10:52:32.981911 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Name: tempest-AttachVolumeNegativeTest-1311706498-project Jun 30 10:52:32.981911 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: method: > Jun 30 10:52:32.981911 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: exception: Instance 71a25d37-33ee-4e2f-a2b3-474b211268c4 could not be found. Jun 30 10:52:32.981911 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: action_args: {'id': '71a25d37-33ee-4e2f-a2b3-474b211268c4'} Jun 30 10:52:32.982796 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:52:32.982796 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:52:32.982796 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 10:52:32.982796 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 10:52:32.982796 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 10:52:32.982796 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 10:52:32.982796 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 10:52:32.982796 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 10:52:32.982796 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 10:52:32.982796 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 10:52:32.982796 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71a25d37-33ee-4e2f-a2b3-474b211268c4 could not be found. Jun 30 10:52:32.982796 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:52:32.982796 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:52:32.982796 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:52:32.982796 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:52:32.982796 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:52:32.982796 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:52:32.982796 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:52:32.982796 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:52:32.982796 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:52:32.984161 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:52:32.984161 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 10:52:32.984161 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 10:52:32.984161 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 10:52:32.984161 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 10:52:32.984161 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 10:52:32.984161 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:52:32.984161 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71a25d37-33ee-4e2f-a2b3-474b211268c4 could not be found. Jun 30 10:52:32.984161 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:52:32.984161 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:52:32.984161 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:52:32.984161 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:52:32.984161 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:52:32.984161 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:52:32.984161 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:52:32.984161 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:52:32.984161 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71a25d37-33ee-4e2f-a2b3-474b211268c4 could not be found. Jun 30 10:52:32.984161 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:52:32.988710 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-4b9b7777-d165-4425-9f01-1827e842aaa9 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Returning 404 to user: Instance 71a25d37-33ee-4e2f-a2b3-474b211268c4 could not be found. {{(pid=124204) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:52:32.989794 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-4b9b7777-d165-4425-9f01-1827e842aaa9 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/71a25d37-33ee-4e2f-a2b3-474b211268c4" status: 404 len: 111 microversion: 2.1 time: 0.075509 Jun 30 10:52:32.990873 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 549/1116] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:52:32 2022] GET /compute/v2.1/servers/71a25d37-33ee-4e2f-a2b3-474b211268c4 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 10:52:33.001583 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-1aaa364d-1e89-4199-8185-b6283bbe3655 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '.version_select at 0x7f4daddbe5e0>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:52:33.028586 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-1aaa364d-1e89-4199-8185-b6283bbe3655 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1940803245" status: 202 len: 0 microversion: 2.1 time: 0.032537 Jun 30 10:52:33.029765 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 568/1117] 10.222.0.59 () {58 vars in 1220 bytes} [Thu Jun 30 10:52:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1940803245 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 10:52:33.376292 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-3aeab0ba-6055-4fbd-a6d8-5c0d03129e00 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Action: 'create', calling method: .version_select at 0x7f4daddc7820>, body: {"keypair": {"name": "tempest-TestShelveInstance-1596741002", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZjW/ug6tDKJMEyjgXbmDZ7WzxxekO0wnZB7o1VnrhaIfaAxgTbX+fdST8rD5ol4z0mNEU0SQevNjDCfMV2G4ONccnkia2MMyo8jIH+DvhkrvWBi4cTscjAz+QgndEY9w=="}} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:52:33.393582 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.quota [None req-3aeab0ba-6055-4fbd-a6d8-5c0d03129e00 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Getting quotas for project 8819274ed13f4f3f848fb7be9e295815. Resources: {'key_pairs'} {{(pid=124204) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 10:52:33.398239 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.quota [None req-3aeab0ba-6055-4fbd-a6d8-5c0d03129e00 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Getting quotas for user 8453bd18330b40af9efac8d72d749141 and project 8819274ed13f4f3f848fb7be9e295815. Resources: {'key_pairs'} {{(pid=124204) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 10:52:33.441782 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-3aeab0ba-6055-4fbd-a6d8-5c0d03129e00 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.308663 Jun 30 10:52:33.450301 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 550/1118] 10.222.0.59 () {60 vars in 1158 bytes} [Thu Jun 30 10:52:33 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:52:34.978832 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-84aa0e45-8cb8-4d35-95fb-48f4695f1c8a tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:52:34.980349 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-84aa0e45-8cb8-4d35-95fb-48f4695f1c8a tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 71a25d37-33ee-4e2f-a2b3-474b211268c4] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:52:34.989766 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-84aa0e45-8cb8-4d35-95fb-48f4695f1c8a tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:34.990461 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-84aa0e45-8cb8-4d35-95fb-48f4695f1c8a tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:34.991499 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-84aa0e45-8cb8-4d35-95fb-48f4695f1c8a tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:34.992203 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-84aa0e45-8cb8-4d35-95fb-48f4695f1c8a tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:35.007920 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.wsgi [None req-84aa0e45-8cb8-4d35-95fb-48f4695f1c8a tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] HTTP exception thrown: Instance 71a25d37-33ee-4e2f-a2b3-474b211268c4 could not be found. Jun 30 10:52:35.010153 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-84aa0e45-8cb8-4d35-95fb-48f4695f1c8a tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Request method failure captured: Jun 30 10:52:35.010153 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: request: DELETE /compute/v2.1/servers/71a25d37-33ee-4e2f-a2b3-474b211268c4 HTTP/1.1 Jun 30 10:52:35.010153 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Accept: application/json Jun 30 10:52:35.010153 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Accept-Encoding: identity Jun 30 10:52:35.010153 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Connection: close Jun 30 10:52:35.010153 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Content-Length: 0 Jun 30 10:52:35.010153 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Content-Type: application/json Jun 30 10:52:35.010153 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Host: 10.222.0.59 Jun 30 10:52:35.010153 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Openstack-System-Scope: None Jun 30 10:52:35.010153 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: User-Agent: python-urllib3/1.26.9 Jun 30 10:52:35.010153 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Auth-Token: gAAAAABivX2SDXLzZddWIKNVN1nlKFPwtYJlUUF8PxnvIHmdlvz3CWxsmmlutMh4nwIcp8e29jVTyW0L2PeVImDMIlnOZ-7kokNBpPBYwuv_h-8Q51jKjjG2cB0Se9mEglmc0BxaTnOJa9GnDeBKjS31T1Z6kscoN_FtN_Ly_k2htqmUscjC_wQ Jun 30 10:52:35.010153 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Domain-Id: None Jun 30 10:52:35.010153 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Domain-Name: None Jun 30 10:52:35.010153 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Identity-Status: Confirmed Jun 30 10:52:35.010153 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Is-Admin-Project: True Jun 30 10:52:35.010153 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Domain-Id: default Jun 30 10:52:35.010153 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Domain-Name: Default Jun 30 10:52:35.010153 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Id: 848d69e5041341488aafc3e6d26d491c Jun 30 10:52:35.010153 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Name: tempest-AttachVolumeNegativeTest-1311706498 Jun 30 10:52:35.010153 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Role: member,reader Jun 30 10:52:35.010153 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Roles: member,reader Jun 30 10:52:35.011631 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/848d69e5041341488aafc3e6d26d491c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_848d69e5041341488aafc3e6d26d491c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/848d69e5041341488aafc3e6d26d491c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/848d69e5041341488aafc3e6d26d491c"}]}] Jun 30 10:52:35.011631 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant: tempest-AttachVolumeNegativeTest-1311706498 Jun 30 10:52:35.011631 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant-Id: 848d69e5041341488aafc3e6d26d491c Jun 30 10:52:35.011631 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1311706498 Jun 30 10:52:35.011631 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User: tempest-AttachVolumeNegativeTest-1311706498-project Jun 30 10:52:35.011631 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Domain-Id: default Jun 30 10:52:35.011631 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Domain-Name: Default Jun 30 10:52:35.011631 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Id: d6a194d68415422fbc6ca75a8dbccf22 Jun 30 10:52:35.011631 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Name: tempest-AttachVolumeNegativeTest-1311706498-project Jun 30 10:52:35.011631 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: method: > Jun 30 10:52:35.011631 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: exception: Instance 71a25d37-33ee-4e2f-a2b3-474b211268c4 could not be found. Jun 30 10:52:35.011631 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: action_args: {'id': '71a25d37-33ee-4e2f-a2b3-474b211268c4'} Jun 30 10:52:35.012416 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:52:35.012416 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:52:35.012416 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 10:52:35.012416 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 10:52:35.012416 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 10:52:35.012416 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 10:52:35.012416 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 10:52:35.012416 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 10:52:35.012416 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 10:52:35.012416 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 10:52:35.012416 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71a25d37-33ee-4e2f-a2b3-474b211268c4 could not be found. Jun 30 10:52:35.012416 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:52:35.012416 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:52:35.012416 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:52:35.012416 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:52:35.012416 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:52:35.012416 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:52:35.012416 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:52:35.012416 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:52:35.012416 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:52:35.013681 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:52:35.013681 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 10:52:35.013681 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 10:52:35.013681 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 10:52:35.013681 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 10:52:35.013681 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 10:52:35.013681 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 10:52:35.013681 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 10:52:35.013681 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:52:35.013681 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71a25d37-33ee-4e2f-a2b3-474b211268c4 could not be found. Jun 30 10:52:35.013681 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:52:35.013681 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:52:35.013681 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:52:35.013681 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:52:35.013681 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:52:35.013681 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:52:35.013681 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:52:35.013681 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:52:35.013681 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71a25d37-33ee-4e2f-a2b3-474b211268c4 could not be found. Jun 30 10:52:35.013681 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:52:35.015677 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-84aa0e45-8cb8-4d35-95fb-48f4695f1c8a tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Returning 404 to user: Instance 71a25d37-33ee-4e2f-a2b3-474b211268c4 could not be found. {{(pid=124203) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:52:35.016971 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-84aa0e45-8cb8-4d35-95fb-48f4695f1c8a tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "DELETE /compute/v2.1/servers/71a25d37-33ee-4e2f-a2b3-474b211268c4" status: 404 len: 111 microversion: 2.1 time: 0.043191 Jun 30 10:52:35.017748 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 569/1119] 10.222.0.59 () {58 vars in 1238 bytes} [Thu Jun 30 10:52:34 2022] DELETE /compute/v2.1/servers/71a25d37-33ee-4e2f-a2b3-474b211268c4 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 10:52:35.027699 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-0bd6fc21-82da-4a5d-99a9-53b9df403b36 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:52:35.028324 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-0bd6fc21-82da-4a5d-99a9-53b9df403b36 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 71a25d37-33ee-4e2f-a2b3-474b211268c4] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:52:35.038413 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-0bd6fc21-82da-4a5d-99a9-53b9df403b36 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:35.039132 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-0bd6fc21-82da-4a5d-99a9-53b9df403b36 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:35.040093 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-0bd6fc21-82da-4a5d-99a9-53b9df403b36 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:35.040749 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-0bd6fc21-82da-4a5d-99a9-53b9df403b36 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:35.059789 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.wsgi [None req-0bd6fc21-82da-4a5d-99a9-53b9df403b36 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] HTTP exception thrown: Instance 71a25d37-33ee-4e2f-a2b3-474b211268c4 could not be found. Jun 30 10:52:35.061324 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-0bd6fc21-82da-4a5d-99a9-53b9df403b36 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Request method failure captured: Jun 30 10:52:35.061324 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: request: GET /compute/v2.1/servers/71a25d37-33ee-4e2f-a2b3-474b211268c4 HTTP/1.1 Jun 30 10:52:35.061324 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Accept: application/json Jun 30 10:52:35.061324 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Accept-Encoding: identity Jun 30 10:52:35.061324 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Connection: close Jun 30 10:52:35.061324 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Content-Length: 0 Jun 30 10:52:35.061324 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Content-Type: application/json Jun 30 10:52:35.061324 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Host: 10.222.0.59 Jun 30 10:52:35.061324 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Openstack-System-Scope: None Jun 30 10:52:35.061324 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: User-Agent: python-urllib3/1.26.9 Jun 30 10:52:35.061324 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Auth-Token: gAAAAABivX2SDXLzZddWIKNVN1nlKFPwtYJlUUF8PxnvIHmdlvz3CWxsmmlutMh4nwIcp8e29jVTyW0L2PeVImDMIlnOZ-7kokNBpPBYwuv_h-8Q51jKjjG2cB0Se9mEglmc0BxaTnOJa9GnDeBKjS31T1Z6kscoN_FtN_Ly_k2htqmUscjC_wQ Jun 30 10:52:35.061324 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Domain-Id: None Jun 30 10:52:35.061324 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Domain-Name: None Jun 30 10:52:35.061324 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Identity-Status: Confirmed Jun 30 10:52:35.061324 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Is-Admin-Project: True Jun 30 10:52:35.061324 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Domain-Id: default Jun 30 10:52:35.061324 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Domain-Name: Default Jun 30 10:52:35.061324 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Id: 848d69e5041341488aafc3e6d26d491c Jun 30 10:52:35.061324 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Name: tempest-AttachVolumeNegativeTest-1311706498 Jun 30 10:52:35.061324 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Role: member,reader Jun 30 10:52:35.061324 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Roles: member,reader Jun 30 10:52:35.062680 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/848d69e5041341488aafc3e6d26d491c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_848d69e5041341488aafc3e6d26d491c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/848d69e5041341488aafc3e6d26d491c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/848d69e5041341488aafc3e6d26d491c"}]}] Jun 30 10:52:35.062680 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant: tempest-AttachVolumeNegativeTest-1311706498 Jun 30 10:52:35.062680 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant-Id: 848d69e5041341488aafc3e6d26d491c Jun 30 10:52:35.062680 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1311706498 Jun 30 10:52:35.062680 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User: tempest-AttachVolumeNegativeTest-1311706498-project Jun 30 10:52:35.062680 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Domain-Id: default Jun 30 10:52:35.062680 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Domain-Name: Default Jun 30 10:52:35.062680 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Id: d6a194d68415422fbc6ca75a8dbccf22 Jun 30 10:52:35.062680 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Name: tempest-AttachVolumeNegativeTest-1311706498-project Jun 30 10:52:35.062680 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: method: > Jun 30 10:52:35.062680 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: exception: Instance 71a25d37-33ee-4e2f-a2b3-474b211268c4 could not be found. Jun 30 10:52:35.062680 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: action_args: {'id': '71a25d37-33ee-4e2f-a2b3-474b211268c4'} Jun 30 10:52:35.063426 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:52:35.063426 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:52:35.063426 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 10:52:35.063426 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 10:52:35.063426 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 10:52:35.063426 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 10:52:35.063426 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 10:52:35.063426 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 10:52:35.063426 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 10:52:35.063426 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 10:52:35.063426 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71a25d37-33ee-4e2f-a2b3-474b211268c4 could not be found. Jun 30 10:52:35.063426 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:52:35.063426 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:52:35.063426 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:52:35.063426 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:52:35.063426 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:52:35.063426 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:52:35.063426 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:52:35.063426 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:52:35.063426 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:52:35.064788 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:52:35.064788 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 10:52:35.064788 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 10:52:35.064788 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 10:52:35.064788 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 10:52:35.064788 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 10:52:35.064788 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:52:35.064788 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71a25d37-33ee-4e2f-a2b3-474b211268c4 could not be found. Jun 30 10:52:35.064788 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:52:35.064788 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:52:35.064788 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:52:35.064788 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:52:35.064788 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:52:35.064788 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:52:35.064788 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:52:35.064788 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:52:35.064788 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71a25d37-33ee-4e2f-a2b3-474b211268c4 could not be found. Jun 30 10:52:35.064788 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:52:35.065892 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-0bd6fc21-82da-4a5d-99a9-53b9df403b36 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Returning 404 to user: Instance 71a25d37-33ee-4e2f-a2b3-474b211268c4 could not be found. {{(pid=124204) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:52:35.065892 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-0bd6fc21-82da-4a5d-99a9-53b9df403b36 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/71a25d37-33ee-4e2f-a2b3-474b211268c4" status: 404 len: 111 microversion: 2.1 time: 0.041476 Jun 30 10:52:35.065892 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 551/1120] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:52:35 2022] GET /compute/v2.1/servers/71a25d37-33ee-4e2f-a2b3-474b211268c4 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 10:52:36.239539 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-075a5f8b-bf35-4c50-be81-d55437b953dd tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:52:36.240063 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-075a5f8b-bf35-4c50-be81-d55437b953dd tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 5729f9ae-3c4d-490a-9501-b4806724de9d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:52:36.248300 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-075a5f8b-bf35-4c50-be81-d55437b953dd tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:36.248791 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-075a5f8b-bf35-4c50-be81-d55437b953dd tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:36.249580 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-075a5f8b-bf35-4c50-be81-d55437b953dd tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:36.250025 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-075a5f8b-bf35-4c50-be81-d55437b953dd tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:36.266896 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.wsgi [None req-075a5f8b-bf35-4c50-be81-d55437b953dd tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] HTTP exception thrown: Instance 5729f9ae-3c4d-490a-9501-b4806724de9d could not be found. Jun 30 10:52:36.269325 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-075a5f8b-bf35-4c50-be81-d55437b953dd tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Request method failure captured: Jun 30 10:52:36.269325 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: request: DELETE /compute/v2.1/servers/5729f9ae-3c4d-490a-9501-b4806724de9d HTTP/1.1 Jun 30 10:52:36.269325 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Accept: application/json Jun 30 10:52:36.269325 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Accept-Encoding: identity Jun 30 10:52:36.269325 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Connection: close Jun 30 10:52:36.269325 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Content-Length: 0 Jun 30 10:52:36.269325 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Content-Type: application/json Jun 30 10:52:36.269325 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Host: 10.222.0.59 Jun 30 10:52:36.269325 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Openstack-System-Scope: None Jun 30 10:52:36.269325 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: User-Agent: python-urllib3/1.26.9 Jun 30 10:52:36.269325 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Auth-Token: gAAAAABivX2SDXLzZddWIKNVN1nlKFPwtYJlUUF8PxnvIHmdlvz3CWxsmmlutMh4nwIcp8e29jVTyW0L2PeVImDMIlnOZ-7kokNBpPBYwuv_h-8Q51jKjjG2cB0Se9mEglmc0BxaTnOJa9GnDeBKjS31T1Z6kscoN_FtN_Ly_k2htqmUscjC_wQ Jun 30 10:52:36.269325 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Domain-Id: None Jun 30 10:52:36.269325 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Domain-Name: None Jun 30 10:52:36.269325 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Identity-Status: Confirmed Jun 30 10:52:36.269325 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Is-Admin-Project: True Jun 30 10:52:36.269325 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Domain-Id: default Jun 30 10:52:36.269325 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Domain-Name: Default Jun 30 10:52:36.269325 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Id: 848d69e5041341488aafc3e6d26d491c Jun 30 10:52:36.269325 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Name: tempest-AttachVolumeNegativeTest-1311706498 Jun 30 10:52:36.269325 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Role: member,reader Jun 30 10:52:36.269325 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Roles: member,reader Jun 30 10:52:36.270712 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/848d69e5041341488aafc3e6d26d491c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_848d69e5041341488aafc3e6d26d491c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/848d69e5041341488aafc3e6d26d491c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/848d69e5041341488aafc3e6d26d491c"}]}] Jun 30 10:52:36.270712 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant: tempest-AttachVolumeNegativeTest-1311706498 Jun 30 10:52:36.270712 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant-Id: 848d69e5041341488aafc3e6d26d491c Jun 30 10:52:36.270712 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1311706498 Jun 30 10:52:36.270712 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User: tempest-AttachVolumeNegativeTest-1311706498-project Jun 30 10:52:36.270712 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Domain-Id: default Jun 30 10:52:36.270712 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Domain-Name: Default Jun 30 10:52:36.270712 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Id: d6a194d68415422fbc6ca75a8dbccf22 Jun 30 10:52:36.270712 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Name: tempest-AttachVolumeNegativeTest-1311706498-project Jun 30 10:52:36.270712 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: method: > Jun 30 10:52:36.270712 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: exception: Instance 5729f9ae-3c4d-490a-9501-b4806724de9d could not be found. Jun 30 10:52:36.270712 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: action_args: {'id': '5729f9ae-3c4d-490a-9501-b4806724de9d'} Jun 30 10:52:36.271500 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:52:36.271500 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:52:36.271500 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 10:52:36.271500 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 10:52:36.271500 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 10:52:36.271500 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 10:52:36.271500 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 10:52:36.271500 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 10:52:36.271500 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 10:52:36.271500 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 10:52:36.271500 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5729f9ae-3c4d-490a-9501-b4806724de9d could not be found. Jun 30 10:52:36.271500 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:52:36.271500 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:52:36.271500 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:52:36.271500 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:52:36.271500 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:52:36.271500 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:52:36.271500 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:52:36.271500 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:52:36.271500 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:52:36.272776 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:52:36.272776 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 10:52:36.272776 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 10:52:36.272776 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 10:52:36.272776 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 10:52:36.272776 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 10:52:36.272776 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 10:52:36.272776 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 10:52:36.272776 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:52:36.272776 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5729f9ae-3c4d-490a-9501-b4806724de9d could not be found. Jun 30 10:52:36.272776 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:52:36.272776 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:52:36.272776 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:52:36.272776 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:52:36.272776 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:52:36.272776 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:52:36.272776 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:52:36.272776 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:52:36.272776 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5729f9ae-3c4d-490a-9501-b4806724de9d could not be found. Jun 30 10:52:36.272776 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:52:36.275310 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-075a5f8b-bf35-4c50-be81-d55437b953dd tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Returning 404 to user: Instance 5729f9ae-3c4d-490a-9501-b4806724de9d could not be found. {{(pid=124203) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:52:36.276202 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-075a5f8b-bf35-4c50-be81-d55437b953dd tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "DELETE /compute/v2.1/servers/5729f9ae-3c4d-490a-9501-b4806724de9d" status: 404 len: 111 microversion: 2.1 time: 0.041372 Jun 30 10:52:36.276823 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 570/1121] 10.222.0.59 () {58 vars in 1238 bytes} [Thu Jun 30 10:52:36 2022] DELETE /compute/v2.1/servers/5729f9ae-3c4d-490a-9501-b4806724de9d => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 10:52:36.286862 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-e1d3feff-a77e-48b7-8f19-3b0daa7dfbbf tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:52:36.287493 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-e1d3feff-a77e-48b7-8f19-3b0daa7dfbbf tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 5729f9ae-3c4d-490a-9501-b4806724de9d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:52:36.295917 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-e1d3feff-a77e-48b7-8f19-3b0daa7dfbbf tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:36.296359 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-e1d3feff-a77e-48b7-8f19-3b0daa7dfbbf tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:36.297153 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-e1d3feff-a77e-48b7-8f19-3b0daa7dfbbf tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:36.297581 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-e1d3feff-a77e-48b7-8f19-3b0daa7dfbbf tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:36.313646 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.wsgi [None req-e1d3feff-a77e-48b7-8f19-3b0daa7dfbbf tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] HTTP exception thrown: Instance 5729f9ae-3c4d-490a-9501-b4806724de9d could not be found. Jun 30 10:52:36.318241 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-e1d3feff-a77e-48b7-8f19-3b0daa7dfbbf tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Request method failure captured: Jun 30 10:52:36.318241 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: request: GET /compute/v2.1/servers/5729f9ae-3c4d-490a-9501-b4806724de9d HTTP/1.1 Jun 30 10:52:36.318241 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Accept: application/json Jun 30 10:52:36.318241 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Accept-Encoding: identity Jun 30 10:52:36.318241 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Connection: close Jun 30 10:52:36.318241 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Content-Length: 0 Jun 30 10:52:36.318241 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Content-Type: application/json Jun 30 10:52:36.318241 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Host: 10.222.0.59 Jun 30 10:52:36.318241 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Openstack-System-Scope: None Jun 30 10:52:36.318241 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: User-Agent: python-urllib3/1.26.9 Jun 30 10:52:36.318241 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Auth-Token: gAAAAABivX2SDXLzZddWIKNVN1nlKFPwtYJlUUF8PxnvIHmdlvz3CWxsmmlutMh4nwIcp8e29jVTyW0L2PeVImDMIlnOZ-7kokNBpPBYwuv_h-8Q51jKjjG2cB0Se9mEglmc0BxaTnOJa9GnDeBKjS31T1Z6kscoN_FtN_Ly_k2htqmUscjC_wQ Jun 30 10:52:36.318241 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Domain-Id: None Jun 30 10:52:36.318241 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Domain-Name: None Jun 30 10:52:36.318241 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Identity-Status: Confirmed Jun 30 10:52:36.318241 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Is-Admin-Project: True Jun 30 10:52:36.318241 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Domain-Id: default Jun 30 10:52:36.318241 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Domain-Name: Default Jun 30 10:52:36.318241 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Id: 848d69e5041341488aafc3e6d26d491c Jun 30 10:52:36.318241 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Name: tempest-AttachVolumeNegativeTest-1311706498 Jun 30 10:52:36.318241 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Role: member,reader Jun 30 10:52:36.318241 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Roles: member,reader Jun 30 10:52:36.319931 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/848d69e5041341488aafc3e6d26d491c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_848d69e5041341488aafc3e6d26d491c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/848d69e5041341488aafc3e6d26d491c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/848d69e5041341488aafc3e6d26d491c"}]}] Jun 30 10:52:36.319931 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant: tempest-AttachVolumeNegativeTest-1311706498 Jun 30 10:52:36.319931 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant-Id: 848d69e5041341488aafc3e6d26d491c Jun 30 10:52:36.319931 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1311706498 Jun 30 10:52:36.319931 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User: tempest-AttachVolumeNegativeTest-1311706498-project Jun 30 10:52:36.319931 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Domain-Id: default Jun 30 10:52:36.319931 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Domain-Name: Default Jun 30 10:52:36.319931 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Id: d6a194d68415422fbc6ca75a8dbccf22 Jun 30 10:52:36.319931 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Name: tempest-AttachVolumeNegativeTest-1311706498-project Jun 30 10:52:36.319931 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: method: > Jun 30 10:52:36.319931 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: exception: Instance 5729f9ae-3c4d-490a-9501-b4806724de9d could not be found. Jun 30 10:52:36.319931 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: action_args: {'id': '5729f9ae-3c4d-490a-9501-b4806724de9d'} Jun 30 10:52:36.323929 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:52:36.323929 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:52:36.323929 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 10:52:36.323929 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 10:52:36.323929 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 10:52:36.323929 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 10:52:36.323929 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 10:52:36.323929 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 10:52:36.323929 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 10:52:36.323929 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 10:52:36.323929 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5729f9ae-3c4d-490a-9501-b4806724de9d could not be found. Jun 30 10:52:36.323929 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:52:36.323929 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:52:36.323929 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:52:36.323929 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:52:36.323929 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:52:36.323929 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:52:36.323929 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:52:36.323929 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:52:36.323929 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:52:36.325493 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:52:36.325493 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 10:52:36.325493 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 10:52:36.325493 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 10:52:36.325493 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 10:52:36.325493 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 10:52:36.325493 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:52:36.325493 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5729f9ae-3c4d-490a-9501-b4806724de9d could not be found. Jun 30 10:52:36.325493 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:52:36.325493 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:52:36.325493 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:52:36.325493 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:52:36.325493 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:52:36.325493 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:52:36.325493 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:52:36.325493 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:52:36.325493 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5729f9ae-3c4d-490a-9501-b4806724de9d could not be found. Jun 30 10:52:36.325493 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:52:36.327216 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-e1d3feff-a77e-48b7-8f19-3b0daa7dfbbf tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Returning 404 to user: Instance 5729f9ae-3c4d-490a-9501-b4806724de9d could not be found. {{(pid=124204) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:52:36.327216 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-e1d3feff-a77e-48b7-8f19-3b0daa7dfbbf tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/5729f9ae-3c4d-490a-9501-b4806724de9d" status: 404 len: 111 microversion: 2.1 time: 0.038480 Jun 30 10:52:36.327216 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 552/1122] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:52:36 2022] GET /compute/v2.1/servers/5729f9ae-3c4d-490a-9501-b4806724de9d => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 30 10:52:36.328890 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-3d56a2ab-7d0a-463b-8589-e053ae1ee549 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:52:36.329392 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-3d56a2ab-7d0a-463b-8589-e053ae1ee549 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: b4ed536b-47ac-4405-a11b-e2ed38021db3] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:52:36.335760 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-3d56a2ab-7d0a-463b-8589-e053ae1ee549 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:36.336216 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-3d56a2ab-7d0a-463b-8589-e053ae1ee549 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:36.337062 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-3d56a2ab-7d0a-463b-8589-e053ae1ee549 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:36.337986 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-3d56a2ab-7d0a-463b-8589-e053ae1ee549 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:36.360650 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.wsgi [None req-3d56a2ab-7d0a-463b-8589-e053ae1ee549 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] HTTP exception thrown: Instance b4ed536b-47ac-4405-a11b-e2ed38021db3 could not be found. Jun 30 10:52:36.362232 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-3d56a2ab-7d0a-463b-8589-e053ae1ee549 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Request method failure captured: Jun 30 10:52:36.362232 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: request: DELETE /compute/v2.1/servers/b4ed536b-47ac-4405-a11b-e2ed38021db3 HTTP/1.1 Jun 30 10:52:36.362232 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Accept: application/json Jun 30 10:52:36.362232 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Accept-Encoding: identity Jun 30 10:52:36.362232 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Connection: close Jun 30 10:52:36.362232 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Content-Length: 0 Jun 30 10:52:36.362232 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Content-Type: application/json Jun 30 10:52:36.362232 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Host: 10.222.0.59 Jun 30 10:52:36.362232 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Openstack-System-Scope: None Jun 30 10:52:36.362232 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: User-Agent: python-urllib3/1.26.9 Jun 30 10:52:36.362232 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Auth-Token: gAAAAABivX2SDXLzZddWIKNVN1nlKFPwtYJlUUF8PxnvIHmdlvz3CWxsmmlutMh4nwIcp8e29jVTyW0L2PeVImDMIlnOZ-7kokNBpPBYwuv_h-8Q51jKjjG2cB0Se9mEglmc0BxaTnOJa9GnDeBKjS31T1Z6kscoN_FtN_Ly_k2htqmUscjC_wQ Jun 30 10:52:36.362232 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Domain-Id: None Jun 30 10:52:36.362232 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Domain-Name: None Jun 30 10:52:36.362232 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Identity-Status: Confirmed Jun 30 10:52:36.362232 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Is-Admin-Project: True Jun 30 10:52:36.362232 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Domain-Id: default Jun 30 10:52:36.362232 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Domain-Name: Default Jun 30 10:52:36.362232 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Id: 848d69e5041341488aafc3e6d26d491c Jun 30 10:52:36.362232 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Name: tempest-AttachVolumeNegativeTest-1311706498 Jun 30 10:52:36.362232 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Role: member,reader Jun 30 10:52:36.362232 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Roles: member,reader Jun 30 10:52:36.363585 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/848d69e5041341488aafc3e6d26d491c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_848d69e5041341488aafc3e6d26d491c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/848d69e5041341488aafc3e6d26d491c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/848d69e5041341488aafc3e6d26d491c"}]}] Jun 30 10:52:36.363585 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant: tempest-AttachVolumeNegativeTest-1311706498 Jun 30 10:52:36.363585 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant-Id: 848d69e5041341488aafc3e6d26d491c Jun 30 10:52:36.363585 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1311706498 Jun 30 10:52:36.363585 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User: tempest-AttachVolumeNegativeTest-1311706498-project Jun 30 10:52:36.363585 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Domain-Id: default Jun 30 10:52:36.363585 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Domain-Name: Default Jun 30 10:52:36.363585 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Id: d6a194d68415422fbc6ca75a8dbccf22 Jun 30 10:52:36.363585 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Name: tempest-AttachVolumeNegativeTest-1311706498-project Jun 30 10:52:36.363585 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: method: > Jun 30 10:52:36.363585 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: exception: Instance b4ed536b-47ac-4405-a11b-e2ed38021db3 could not be found. Jun 30 10:52:36.363585 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: action_args: {'id': 'b4ed536b-47ac-4405-a11b-e2ed38021db3'} Jun 30 10:52:36.364332 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:52:36.364332 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:52:36.364332 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 10:52:36.364332 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 10:52:36.364332 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 10:52:36.364332 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 10:52:36.364332 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 10:52:36.364332 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 10:52:36.364332 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 10:52:36.364332 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 10:52:36.364332 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4ed536b-47ac-4405-a11b-e2ed38021db3 could not be found. Jun 30 10:52:36.364332 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:52:36.364332 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:52:36.364332 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:52:36.364332 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:52:36.364332 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:52:36.364332 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:52:36.364332 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:52:36.364332 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:52:36.364332 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:52:36.365761 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:52:36.365761 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 10:52:36.365761 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 10:52:36.365761 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 10:52:36.365761 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 10:52:36.365761 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 10:52:36.365761 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 10:52:36.365761 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 10:52:36.365761 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:52:36.365761 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4ed536b-47ac-4405-a11b-e2ed38021db3 could not be found. Jun 30 10:52:36.365761 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:52:36.365761 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:52:36.365761 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:52:36.365761 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:52:36.365761 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:52:36.365761 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:52:36.365761 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:52:36.365761 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:52:36.365761 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4ed536b-47ac-4405-a11b-e2ed38021db3 could not be found. Jun 30 10:52:36.365761 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:52:36.367036 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-3d56a2ab-7d0a-463b-8589-e053ae1ee549 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Returning 404 to user: Instance b4ed536b-47ac-4405-a11b-e2ed38021db3 could not be found. {{(pid=124203) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:52:36.367036 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-3d56a2ab-7d0a-463b-8589-e053ae1ee549 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "DELETE /compute/v2.1/servers/b4ed536b-47ac-4405-a11b-e2ed38021db3" status: 404 len: 111 microversion: 2.1 time: 0.039336 Jun 30 10:52:36.367036 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 571/1123] 10.222.0.59 () {58 vars in 1238 bytes} [Thu Jun 30 10:52:36 2022] DELETE /compute/v2.1/servers/b4ed536b-47ac-4405-a11b-e2ed38021db3 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 10:52:36.376917 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-77491c37-4a13-4c7e-9d20-e7a5e1fd6d83 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:52:36.377603 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-77491c37-4a13-4c7e-9d20-e7a5e1fd6d83 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: b4ed536b-47ac-4405-a11b-e2ed38021db3] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:52:36.386764 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-77491c37-4a13-4c7e-9d20-e7a5e1fd6d83 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:36.387612 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-77491c37-4a13-4c7e-9d20-e7a5e1fd6d83 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:36.389190 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-77491c37-4a13-4c7e-9d20-e7a5e1fd6d83 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:36.389638 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-77491c37-4a13-4c7e-9d20-e7a5e1fd6d83 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:36.405136 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.wsgi [None req-77491c37-4a13-4c7e-9d20-e7a5e1fd6d83 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] HTTP exception thrown: Instance b4ed536b-47ac-4405-a11b-e2ed38021db3 could not be found. Jun 30 10:52:36.406925 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-77491c37-4a13-4c7e-9d20-e7a5e1fd6d83 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Request method failure captured: Jun 30 10:52:36.406925 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: request: GET /compute/v2.1/servers/b4ed536b-47ac-4405-a11b-e2ed38021db3 HTTP/1.1 Jun 30 10:52:36.406925 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Accept: application/json Jun 30 10:52:36.406925 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Accept-Encoding: identity Jun 30 10:52:36.406925 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Connection: close Jun 30 10:52:36.406925 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Content-Length: 0 Jun 30 10:52:36.406925 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Content-Type: application/json Jun 30 10:52:36.406925 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Host: 10.222.0.59 Jun 30 10:52:36.406925 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Openstack-System-Scope: None Jun 30 10:52:36.406925 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: User-Agent: python-urllib3/1.26.9 Jun 30 10:52:36.406925 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Auth-Token: gAAAAABivX2SDXLzZddWIKNVN1nlKFPwtYJlUUF8PxnvIHmdlvz3CWxsmmlutMh4nwIcp8e29jVTyW0L2PeVImDMIlnOZ-7kokNBpPBYwuv_h-8Q51jKjjG2cB0Se9mEglmc0BxaTnOJa9GnDeBKjS31T1Z6kscoN_FtN_Ly_k2htqmUscjC_wQ Jun 30 10:52:36.406925 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Domain-Id: None Jun 30 10:52:36.406925 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Domain-Name: None Jun 30 10:52:36.406925 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Identity-Status: Confirmed Jun 30 10:52:36.406925 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Is-Admin-Project: True Jun 30 10:52:36.406925 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Domain-Id: default Jun 30 10:52:36.406925 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Domain-Name: Default Jun 30 10:52:36.406925 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Id: 848d69e5041341488aafc3e6d26d491c Jun 30 10:52:36.406925 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Name: tempest-AttachVolumeNegativeTest-1311706498 Jun 30 10:52:36.406925 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Role: member,reader Jun 30 10:52:36.406925 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Roles: member,reader Jun 30 10:52:36.408294 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/848d69e5041341488aafc3e6d26d491c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_848d69e5041341488aafc3e6d26d491c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/848d69e5041341488aafc3e6d26d491c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/848d69e5041341488aafc3e6d26d491c"}]}] Jun 30 10:52:36.408294 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant: tempest-AttachVolumeNegativeTest-1311706498 Jun 30 10:52:36.408294 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant-Id: 848d69e5041341488aafc3e6d26d491c Jun 30 10:52:36.408294 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1311706498 Jun 30 10:52:36.408294 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User: tempest-AttachVolumeNegativeTest-1311706498-project Jun 30 10:52:36.408294 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Domain-Id: default Jun 30 10:52:36.408294 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Domain-Name: Default Jun 30 10:52:36.408294 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Id: d6a194d68415422fbc6ca75a8dbccf22 Jun 30 10:52:36.408294 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Name: tempest-AttachVolumeNegativeTest-1311706498-project Jun 30 10:52:36.408294 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: method: > Jun 30 10:52:36.408294 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: exception: Instance b4ed536b-47ac-4405-a11b-e2ed38021db3 could not be found. Jun 30 10:52:36.408294 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: action_args: {'id': 'b4ed536b-47ac-4405-a11b-e2ed38021db3'} Jun 30 10:52:36.409244 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:52:36.409244 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:52:36.409244 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 10:52:36.409244 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 10:52:36.409244 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 10:52:36.409244 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 10:52:36.409244 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 10:52:36.409244 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 10:52:36.409244 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 10:52:36.409244 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 10:52:36.409244 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4ed536b-47ac-4405-a11b-e2ed38021db3 could not be found. Jun 30 10:52:36.409244 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:52:36.409244 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:52:36.409244 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:52:36.409244 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:52:36.409244 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:52:36.409244 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:52:36.409244 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:52:36.409244 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:52:36.409244 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:52:36.410472 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:52:36.410472 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 10:52:36.410472 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 10:52:36.410472 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 10:52:36.410472 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 10:52:36.410472 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 10:52:36.410472 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:52:36.410472 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4ed536b-47ac-4405-a11b-e2ed38021db3 could not be found. Jun 30 10:52:36.410472 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:52:36.410472 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:52:36.410472 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:52:36.410472 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:52:36.410472 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:52:36.410472 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:52:36.410472 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:52:36.410472 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:52:36.410472 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4ed536b-47ac-4405-a11b-e2ed38021db3 could not be found. Jun 30 10:52:36.410472 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:52:36.413298 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-77491c37-4a13-4c7e-9d20-e7a5e1fd6d83 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Returning 404 to user: Instance b4ed536b-47ac-4405-a11b-e2ed38021db3 could not be found. {{(pid=124204) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:52:36.414509 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-77491c37-4a13-4c7e-9d20-e7a5e1fd6d83 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/b4ed536b-47ac-4405-a11b-e2ed38021db3" status: 404 len: 111 microversion: 2.1 time: 0.042535 Jun 30 10:52:36.415611 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 553/1124] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:52:36 2022] GET /compute/v2.1/servers/b4ed536b-47ac-4405-a11b-e2ed38021db3 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 10:52:37.582135 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-c0e9a09d-75f7-4f0f-b7c1-00d1637501d4 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:52:37.582691 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-c0e9a09d-75f7-4f0f-b7c1-00d1637501d4 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 6bc2024c-c05e-4409-a142-e8cf3191a203] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:52:37.590438 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c0e9a09d-75f7-4f0f-b7c1-00d1637501d4 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:37.590865 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c0e9a09d-75f7-4f0f-b7c1-00d1637501d4 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:37.592310 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c0e9a09d-75f7-4f0f-b7c1-00d1637501d4 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:37.592934 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c0e9a09d-75f7-4f0f-b7c1-00d1637501d4 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:37.608820 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.wsgi [None req-c0e9a09d-75f7-4f0f-b7c1-00d1637501d4 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] HTTP exception thrown: Instance 6bc2024c-c05e-4409-a142-e8cf3191a203 could not be found. Jun 30 10:52:37.612662 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-c0e9a09d-75f7-4f0f-b7c1-00d1637501d4 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Request method failure captured: Jun 30 10:52:37.612662 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: request: DELETE /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203 HTTP/1.1 Jun 30 10:52:37.612662 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Accept: application/json Jun 30 10:52:37.612662 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Accept-Encoding: identity Jun 30 10:52:37.612662 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Connection: close Jun 30 10:52:37.612662 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Content-Length: 0 Jun 30 10:52:37.612662 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Content-Type: application/json Jun 30 10:52:37.612662 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Host: 10.222.0.59 Jun 30 10:52:37.612662 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Openstack-System-Scope: None Jun 30 10:52:37.612662 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: User-Agent: python-urllib3/1.26.9 Jun 30 10:52:37.612662 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Auth-Token: gAAAAABivX2SDXLzZddWIKNVN1nlKFPwtYJlUUF8PxnvIHmdlvz3CWxsmmlutMh4nwIcp8e29jVTyW0L2PeVImDMIlnOZ-7kokNBpPBYwuv_h-8Q51jKjjG2cB0Se9mEglmc0BxaTnOJa9GnDeBKjS31T1Z6kscoN_FtN_Ly_k2htqmUscjC_wQ Jun 30 10:52:37.612662 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Domain-Id: None Jun 30 10:52:37.612662 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Domain-Name: None Jun 30 10:52:37.612662 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Identity-Status: Confirmed Jun 30 10:52:37.612662 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Is-Admin-Project: True Jun 30 10:52:37.612662 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Domain-Id: default Jun 30 10:52:37.612662 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Domain-Name: Default Jun 30 10:52:37.612662 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Id: 848d69e5041341488aafc3e6d26d491c Jun 30 10:52:37.612662 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Name: tempest-AttachVolumeNegativeTest-1311706498 Jun 30 10:52:37.612662 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Role: member,reader Jun 30 10:52:37.612662 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Roles: member,reader Jun 30 10:52:37.614173 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/848d69e5041341488aafc3e6d26d491c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_848d69e5041341488aafc3e6d26d491c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/848d69e5041341488aafc3e6d26d491c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/848d69e5041341488aafc3e6d26d491c"}]}] Jun 30 10:52:37.614173 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant: tempest-AttachVolumeNegativeTest-1311706498 Jun 30 10:52:37.614173 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant-Id: 848d69e5041341488aafc3e6d26d491c Jun 30 10:52:37.614173 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1311706498 Jun 30 10:52:37.614173 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User: tempest-AttachVolumeNegativeTest-1311706498-project Jun 30 10:52:37.614173 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Domain-Id: default Jun 30 10:52:37.614173 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Domain-Name: Default Jun 30 10:52:37.614173 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Id: d6a194d68415422fbc6ca75a8dbccf22 Jun 30 10:52:37.614173 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Name: tempest-AttachVolumeNegativeTest-1311706498-project Jun 30 10:52:37.614173 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: method: > Jun 30 10:52:37.614173 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: exception: Instance 6bc2024c-c05e-4409-a142-e8cf3191a203 could not be found. Jun 30 10:52:37.614173 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: action_args: {'id': '6bc2024c-c05e-4409-a142-e8cf3191a203'} Jun 30 10:52:37.614926 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:52:37.614926 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:52:37.614926 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 10:52:37.614926 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 10:52:37.614926 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 10:52:37.614926 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 10:52:37.614926 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 10:52:37.614926 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 10:52:37.614926 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 10:52:37.614926 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 10:52:37.614926 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bc2024c-c05e-4409-a142-e8cf3191a203 could not be found. Jun 30 10:52:37.614926 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:52:37.614926 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:52:37.614926 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:52:37.614926 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:52:37.614926 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:52:37.614926 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:52:37.614926 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:52:37.614926 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:52:37.614926 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:52:37.616158 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:52:37.616158 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 10:52:37.616158 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 10:52:37.616158 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 10:52:37.616158 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 10:52:37.616158 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 10:52:37.616158 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 10:52:37.616158 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 10:52:37.616158 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:52:37.616158 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bc2024c-c05e-4409-a142-e8cf3191a203 could not be found. Jun 30 10:52:37.616158 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:52:37.616158 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:52:37.616158 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:52:37.616158 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:52:37.616158 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:52:37.616158 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:52:37.616158 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:52:37.616158 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:52:37.616158 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bc2024c-c05e-4409-a142-e8cf3191a203 could not be found. Jun 30 10:52:37.616158 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:52:37.621080 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-c0e9a09d-75f7-4f0f-b7c1-00d1637501d4 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Returning 404 to user: Instance 6bc2024c-c05e-4409-a142-e8cf3191a203 could not be found. {{(pid=124203) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:52:37.621080 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-c0e9a09d-75f7-4f0f-b7c1-00d1637501d4 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "DELETE /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203" status: 404 len: 111 microversion: 2.1 time: 0.036998 Jun 30 10:52:37.621080 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 572/1125] 10.222.0.59 () {58 vars in 1238 bytes} [Thu Jun 30 10:52:37 2022] DELETE /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 10:52:37.628038 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-190f601e-e0ec-4cda-a292-4f6f39ccca28 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:52:37.629318 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-190f601e-e0ec-4cda-a292-4f6f39ccca28 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] [instance: 6bc2024c-c05e-4409-a142-e8cf3191a203] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:52:37.642489 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-190f601e-e0ec-4cda-a292-4f6f39ccca28 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:37.642991 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-190f601e-e0ec-4cda-a292-4f6f39ccca28 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:37.643880 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-190f601e-e0ec-4cda-a292-4f6f39ccca28 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:52:37.644372 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-190f601e-e0ec-4cda-a292-4f6f39ccca28 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:52:37.665372 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.wsgi [None req-190f601e-e0ec-4cda-a292-4f6f39ccca28 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] HTTP exception thrown: Instance 6bc2024c-c05e-4409-a142-e8cf3191a203 could not be found. Jun 30 10:52:37.666993 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-190f601e-e0ec-4cda-a292-4f6f39ccca28 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Request method failure captured: Jun 30 10:52:37.666993 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: request: GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203 HTTP/1.1 Jun 30 10:52:37.666993 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Accept: application/json Jun 30 10:52:37.666993 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Accept-Encoding: identity Jun 30 10:52:37.666993 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Connection: close Jun 30 10:52:37.666993 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Content-Length: 0 Jun 30 10:52:37.666993 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Content-Type: application/json Jun 30 10:52:37.666993 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Host: 10.222.0.59 Jun 30 10:52:37.666993 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Openstack-System-Scope: None Jun 30 10:52:37.666993 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: User-Agent: python-urllib3/1.26.9 Jun 30 10:52:37.666993 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Auth-Token: gAAAAABivX2SDXLzZddWIKNVN1nlKFPwtYJlUUF8PxnvIHmdlvz3CWxsmmlutMh4nwIcp8e29jVTyW0L2PeVImDMIlnOZ-7kokNBpPBYwuv_h-8Q51jKjjG2cB0Se9mEglmc0BxaTnOJa9GnDeBKjS31T1Z6kscoN_FtN_Ly_k2htqmUscjC_wQ Jun 30 10:52:37.666993 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Domain-Id: None Jun 30 10:52:37.666993 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Domain-Name: None Jun 30 10:52:37.666993 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Identity-Status: Confirmed Jun 30 10:52:37.666993 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Is-Admin-Project: True Jun 30 10:52:37.666993 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Domain-Id: default Jun 30 10:52:37.666993 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Domain-Name: Default Jun 30 10:52:37.666993 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Id: 848d69e5041341488aafc3e6d26d491c Jun 30 10:52:37.666993 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Name: tempest-AttachVolumeNegativeTest-1311706498 Jun 30 10:52:37.666993 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Role: member,reader Jun 30 10:52:37.666993 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Roles: member,reader Jun 30 10:52:37.668665 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/848d69e5041341488aafc3e6d26d491c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_848d69e5041341488aafc3e6d26d491c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/848d69e5041341488aafc3e6d26d491c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/848d69e5041341488aafc3e6d26d491c"}]}] Jun 30 10:52:37.668665 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant: tempest-AttachVolumeNegativeTest-1311706498 Jun 30 10:52:37.668665 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant-Id: 848d69e5041341488aafc3e6d26d491c Jun 30 10:52:37.668665 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1311706498 Jun 30 10:52:37.668665 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User: tempest-AttachVolumeNegativeTest-1311706498-project Jun 30 10:52:37.668665 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Domain-Id: default Jun 30 10:52:37.668665 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Domain-Name: Default Jun 30 10:52:37.668665 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Id: d6a194d68415422fbc6ca75a8dbccf22 Jun 30 10:52:37.668665 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Name: tempest-AttachVolumeNegativeTest-1311706498-project Jun 30 10:52:37.668665 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: method: > Jun 30 10:52:37.668665 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: exception: Instance 6bc2024c-c05e-4409-a142-e8cf3191a203 could not be found. Jun 30 10:52:37.668665 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: action_args: {'id': '6bc2024c-c05e-4409-a142-e8cf3191a203'} Jun 30 10:52:37.669606 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:52:37.669606 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:52:37.669606 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 10:52:37.669606 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 10:52:37.669606 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 10:52:37.669606 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 10:52:37.669606 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 10:52:37.669606 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 10:52:37.669606 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 10:52:37.669606 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 10:52:37.669606 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bc2024c-c05e-4409-a142-e8cf3191a203 could not be found. Jun 30 10:52:37.669606 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:52:37.669606 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:52:37.669606 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:52:37.669606 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:52:37.669606 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:52:37.669606 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:52:37.669606 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:52:37.669606 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:52:37.669606 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:52:37.671013 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:52:37.671013 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 10:52:37.671013 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 10:52:37.671013 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 10:52:37.671013 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 10:52:37.671013 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 10:52:37.671013 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:52:37.671013 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bc2024c-c05e-4409-a142-e8cf3191a203 could not be found. Jun 30 10:52:37.671013 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:52:37.671013 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:52:37.671013 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:52:37.671013 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:52:37.671013 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:52:37.671013 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:52:37.671013 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:52:37.671013 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:52:37.671013 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bc2024c-c05e-4409-a142-e8cf3191a203 could not be found. Jun 30 10:52:37.671013 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:52:37.672981 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-190f601e-e0ec-4cda-a292-4f6f39ccca28 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] Returning 404 to user: Instance 6bc2024c-c05e-4409-a142-e8cf3191a203 could not be found. {{(pid=124204) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:52:37.672981 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-190f601e-e0ec-4cda-a292-4f6f39ccca28 tempest-AttachVolumeNegativeTest-1311706498 tempest-AttachVolumeNegativeTest-1311706498-project] 10.222.0.59 "GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203" status: 404 len: 111 microversion: 2.1 time: 0.048287 Jun 30 10:52:37.672981 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 554/1126] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:52:37 2022] GET /compute/v2.1/servers/6bc2024c-c05e-4409-a142-e8cf3191a203 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 30 10:52:42.952183 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-6e3eeed7-59ff-4edc-858f-2ecd7c49449e tempest-VolumesNegativeTest-1028387977 tempest-VolumesNegativeTest-1028387977-project] Action: 'create', calling method: .version_select at 0x7f4dade508b0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-233654966", "metadata": {"Type": "work"}}} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:52:42.975909 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-6e3eeed7-59ff-4edc-858f-2ecd7c49449e tempest-VolumesNegativeTest-1028387977 tempest-VolumesNegativeTest-1028387977-project] Request method failure captured: Jun 30 10:52:42.975909 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 30 10:52:42.975909 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Accept: application/json Jun 30 10:52:42.975909 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Accept-Encoding: identity Jun 30 10:52:42.975909 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Connection: close Jun 30 10:52:42.975909 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Content-Length: 121 Jun 30 10:52:42.975909 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Content-Type: application/json Jun 30 10:52:42.975909 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Host: 10.222.0.59 Jun 30 10:52:42.975909 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Openstack-System-Scope: None Jun 30 10:52:42.975909 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: User-Agent: python-urllib3/1.26.9 Jun 30 10:52:42.975909 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Auth-Token: gAAAAABivYB6sEhxUXEVRtq16iLwM1UEBTv1yUFeSOnzasXfk6rVfRf6CIAmSWfeDl8ZD5_xkGAm58c0iSz9ap1gNTuswyvCVmniJcKYqwt9hMd4rVWPUIy6OYacGCtkEyovlNZAjGrp1hFAJtuurpbGu7_7Z1V73OXNXu1d-y2zik-vFJCKoZA Jun 30 10:52:42.975909 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Domain-Id: None Jun 30 10:52:42.975909 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Domain-Name: None Jun 30 10:52:42.975909 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Identity-Status: Confirmed Jun 30 10:52:42.975909 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Is-Admin-Project: True Jun 30 10:52:42.975909 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Domain-Id: default Jun 30 10:52:42.975909 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Domain-Name: Default Jun 30 10:52:42.975909 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Id: 01c427f452ff40b8b6eb680a23ed5ace Jun 30 10:52:42.975909 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Name: tempest-VolumesNegativeTest-1028387977 Jun 30 10:52:42.975909 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Role: member,reader Jun 30 10:52:42.975909 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Roles: member,reader Jun 30 10:52:42.977732 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/01c427f452ff40b8b6eb680a23ed5ace"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_01c427f452ff40b8b6eb680a23ed5ace"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/01c427f452ff40b8b6eb680a23ed5ace"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/01c427f452ff40b8b6eb680a23ed5ace"}]}] Jun 30 10:52:42.977732 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant: tempest-VolumesNegativeTest-1028387977 Jun 30 10:52:42.977732 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant-Id: 01c427f452ff40b8b6eb680a23ed5ace Jun 30 10:52:42.977732 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant-Name: tempest-VolumesNegativeTest-1028387977 Jun 30 10:52:42.977732 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User: tempest-VolumesNegativeTest-1028387977-project Jun 30 10:52:42.977732 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Domain-Id: default Jun 30 10:52:42.977732 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Domain-Name: Default Jun 30 10:52:42.977732 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Id: f13059803ed14f8895be3eb4ef4a638f Jun 30 10:52:42.977732 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Name: tempest-VolumesNegativeTest-1028387977-project Jun 30 10:52:42.977732 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Jun 30 10:52:42.977732 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-233654966", "metadata": {"Type": "work"}}} Jun 30 10:52:42.977732 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: method: Jun 30 10:52:42.977732 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 30 10:52:42.978793 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-233654966', 'metadata': {'Type': 'work'}}}} Jun 30 10:52:42.978793 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:52:42.978793 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:52:42.978793 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 30 10:52:42.978793 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 30 10:52:42.978793 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 30 10:52:42.978793 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise error Jun 30 10:52:42.978793 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 30 10:52:42.978793 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:52:42.978793 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 30 10:52:42.978793 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 30 10:52:42.978793 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:52:42.978793 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 30 10:52:42.978793 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi '#$%' Jun 30 10:52:42.978793 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:52:42.978793 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:52:42.978793 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:52:42.978793 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:52:42.978793 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:52:42.978793 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:52:42.978793 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:52:42.978793 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:52:42.981014 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 10:52:42.981014 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 10:52:42.981014 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:52:42.981014 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:52:42.981014 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 30 10:52:42.981014 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 30 10:52:42.981014 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 30 10:52:42.981014 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 30 10:52:42.981014 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 30 10:52:42.981014 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 30 10:52:42.981014 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 30 10:52:42.981014 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:52:42.981014 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:52:42.981014 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:52:42.981014 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:52:42.981014 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:52:42.981014 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:52:42.981014 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 30 10:52:42.981014 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 30 10:52:42.983190 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 30 10:52:42.983190 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:52:42.983190 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-6e3eeed7-59ff-4edc-858f-2ecd7c49449e tempest-VolumesNegativeTest-1028387977 tempest-VolumesNegativeTest-1028387977-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124203) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:52:42.983190 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-6e3eeed7-59ff-4edc-858f-2ecd7c49449e tempest-VolumesNegativeTest-1028387977 tempest-VolumesNegativeTest-1028387977-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.157612 Jun 30 10:52:42.983190 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 573/1127] 10.222.0.59 () {60 vars in 1155 bytes} [Thu Jun 30 10:52:42 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 159 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 30 10:52:42.989806 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-45ef78a4-3bc1-475b-a314-ae006ee907ff tempest-VolumesNegativeTest-1028387977 tempest-VolumesNegativeTest-1028387977-project] Action: 'create', calling method: .version_select at 0x7f4dade3c1f0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1413836682", "metadata": {"Type": "work"}}} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:52:42.993376 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-45ef78a4-3bc1-475b-a314-ae006ee907ff tempest-VolumesNegativeTest-1028387977 tempest-VolumesNegativeTest-1028387977-project] Request method failure captured: Jun 30 10:52:42.993376 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 30 10:52:42.993376 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Accept: application/json Jun 30 10:52:42.993376 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Accept-Encoding: identity Jun 30 10:52:42.993376 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Connection: close Jun 30 10:52:42.993376 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Content-Length: 120 Jun 30 10:52:42.993376 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Content-Type: application/json Jun 30 10:52:42.993376 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Host: 10.222.0.59 Jun 30 10:52:42.993376 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Openstack-System-Scope: None Jun 30 10:52:42.993376 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: User-Agent: python-urllib3/1.26.9 Jun 30 10:52:42.993376 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Auth-Token: gAAAAABivYB6sEhxUXEVRtq16iLwM1UEBTv1yUFeSOnzasXfk6rVfRf6CIAmSWfeDl8ZD5_xkGAm58c0iSz9ap1gNTuswyvCVmniJcKYqwt9hMd4rVWPUIy6OYacGCtkEyovlNZAjGrp1hFAJtuurpbGu7_7Z1V73OXNXu1d-y2zik-vFJCKoZA Jun 30 10:52:42.993376 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Domain-Id: None Jun 30 10:52:42.993376 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Domain-Name: None Jun 30 10:52:42.993376 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Identity-Status: Confirmed Jun 30 10:52:42.993376 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Is-Admin-Project: True Jun 30 10:52:42.993376 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Domain-Id: default Jun 30 10:52:42.993376 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Domain-Name: Default Jun 30 10:52:42.993376 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Id: 01c427f452ff40b8b6eb680a23ed5ace Jun 30 10:52:42.993376 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Name: tempest-VolumesNegativeTest-1028387977 Jun 30 10:52:42.993376 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Role: member,reader Jun 30 10:52:42.993376 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Roles: member,reader Jun 30 10:52:42.994958 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/01c427f452ff40b8b6eb680a23ed5ace"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_01c427f452ff40b8b6eb680a23ed5ace"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/01c427f452ff40b8b6eb680a23ed5ace"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/01c427f452ff40b8b6eb680a23ed5ace"}]}] Jun 30 10:52:42.994958 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant: tempest-VolumesNegativeTest-1028387977 Jun 30 10:52:42.994958 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant-Id: 01c427f452ff40b8b6eb680a23ed5ace Jun 30 10:52:42.994958 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant-Name: tempest-VolumesNegativeTest-1028387977 Jun 30 10:52:42.994958 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User: tempest-VolumesNegativeTest-1028387977-project Jun 30 10:52:42.994958 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Domain-Id: default Jun 30 10:52:42.994958 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Domain-Name: Default Jun 30 10:52:42.994958 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Id: f13059803ed14f8895be3eb4ef4a638f Jun 30 10:52:42.994958 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Name: tempest-VolumesNegativeTest-1028387977-project Jun 30 10:52:42.994958 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Jun 30 10:52:42.994958 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1413836682", "metadata": {"Type": "work"}}} Jun 30 10:52:42.994958 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: method: Jun 30 10:52:42.994958 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 30 10:52:42.996116 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1413836682', 'metadata': {'Type': 'work'}}}} Jun 30 10:52:42.996116 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:52:42.996116 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:52:42.996116 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 30 10:52:42.996116 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 30 10:52:42.996116 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 30 10:52:42.996116 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise error Jun 30 10:52:42.996116 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 30 10:52:42.996116 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:52:42.996116 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 30 10:52:42.996116 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 30 10:52:42.996116 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:52:42.996116 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 30 10:52:42.996116 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi '0' Jun 30 10:52:42.996116 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:52:42.996116 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:52:42.996116 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:52:42.996116 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:52:42.996116 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:52:42.996116 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:52:42.996116 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:52:42.996116 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:52:42.997773 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 10:52:42.997773 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 10:52:42.997773 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:52:42.997773 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:52:42.997773 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 30 10:52:42.997773 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 30 10:52:42.997773 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 30 10:52:42.997773 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 30 10:52:42.997773 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 30 10:52:42.997773 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 30 10:52:42.997773 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 30 10:52:42.997773 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:52:42.997773 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:52:42.997773 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:52:42.997773 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:52:42.997773 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:52:42.997773 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:52:42.997773 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 30 10:52:42.997773 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 30 10:52:42.999073 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 30 10:52:42.999073 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:52:42.999073 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-45ef78a4-3bc1-475b-a314-ae006ee907ff tempest-VolumesNegativeTest-1028387977 tempest-VolumesNegativeTest-1028387977-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124204) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:52:42.999073 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-45ef78a4-3bc1-475b-a314-ae006ee907ff tempest-VolumesNegativeTest-1028387977 tempest-VolumesNegativeTest-1028387977-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009675 Jun 30 10:52:42.999073 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 555/1128] 10.222.0.59 () {60 vars in 1155 bytes} [Thu Jun 30 10:52:42 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 30 10:52:43.007534 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-5011fdee-d611-469f-875c-207adfa44d3d tempest-VolumesNegativeTest-1028387977 tempest-VolumesNegativeTest-1028387977-project] Action: 'create', calling method: .version_select at 0x7f4dade44160>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-793158003", "metadata": {"Type": "work"}}} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:52:43.010138 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-5011fdee-d611-469f-875c-207adfa44d3d tempest-VolumesNegativeTest-1028387977 tempest-VolumesNegativeTest-1028387977-project] Request method failure captured: Jun 30 10:52:43.010138 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 30 10:52:43.010138 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Accept: application/json Jun 30 10:52:43.010138 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Accept-Encoding: identity Jun 30 10:52:43.010138 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Connection: close Jun 30 10:52:43.010138 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Content-Length: 118 Jun 30 10:52:43.010138 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Content-Type: application/json Jun 30 10:52:43.010138 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Host: 10.222.0.59 Jun 30 10:52:43.010138 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Openstack-System-Scope: None Jun 30 10:52:43.010138 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: User-Agent: python-urllib3/1.26.9 Jun 30 10:52:43.010138 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Auth-Token: gAAAAABivYB6sEhxUXEVRtq16iLwM1UEBTv1yUFeSOnzasXfk6rVfRf6CIAmSWfeDl8ZD5_xkGAm58c0iSz9ap1gNTuswyvCVmniJcKYqwt9hMd4rVWPUIy6OYacGCtkEyovlNZAjGrp1hFAJtuurpbGu7_7Z1V73OXNXu1d-y2zik-vFJCKoZA Jun 30 10:52:43.010138 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Domain-Id: None Jun 30 10:52:43.010138 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Domain-Name: None Jun 30 10:52:43.010138 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Identity-Status: Confirmed Jun 30 10:52:43.010138 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Is-Admin-Project: True Jun 30 10:52:43.010138 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Domain-Id: default Jun 30 10:52:43.010138 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Domain-Name: Default Jun 30 10:52:43.010138 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Id: 01c427f452ff40b8b6eb680a23ed5ace Jun 30 10:52:43.010138 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Name: tempest-VolumesNegativeTest-1028387977 Jun 30 10:52:43.010138 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Role: member,reader Jun 30 10:52:43.010138 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Roles: member,reader Jun 30 10:52:43.011785 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/01c427f452ff40b8b6eb680a23ed5ace"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_01c427f452ff40b8b6eb680a23ed5ace"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/01c427f452ff40b8b6eb680a23ed5ace"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/01c427f452ff40b8b6eb680a23ed5ace"}]}] Jun 30 10:52:43.011785 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant: tempest-VolumesNegativeTest-1028387977 Jun 30 10:52:43.011785 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant-Id: 01c427f452ff40b8b6eb680a23ed5ace Jun 30 10:52:43.011785 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant-Name: tempest-VolumesNegativeTest-1028387977 Jun 30 10:52:43.011785 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User: tempest-VolumesNegativeTest-1028387977-project Jun 30 10:52:43.011785 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Domain-Id: default Jun 30 10:52:43.011785 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Domain-Name: Default Jun 30 10:52:43.011785 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Id: f13059803ed14f8895be3eb4ef4a638f Jun 30 10:52:43.011785 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Name: tempest-VolumesNegativeTest-1028387977-project Jun 30 10:52:43.011785 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Jun 30 10:52:43.011785 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-793158003", "metadata": {"Type": "work"}}} Jun 30 10:52:43.011785 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: method: Jun 30 10:52:43.011785 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 30 10:52:43.012893 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-793158003', 'metadata': {'Type': 'work'}}}} Jun 30 10:52:43.012893 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:52:43.012893 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:52:43.012893 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 30 10:52:43.012893 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 30 10:52:43.012893 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 30 10:52:43.012893 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise error Jun 30 10:52:43.012893 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 30 10:52:43.012893 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:52:43.012893 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 30 10:52:43.012893 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 30 10:52:43.012893 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:52:43.012893 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 30 10:52:43.012893 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi '' Jun 30 10:52:43.012893 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:52:43.012893 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:52:43.012893 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:52:43.012893 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:52:43.012893 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:52:43.012893 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:52:43.012893 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:52:43.012893 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:52:43.014268 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 10:52:43.014268 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 10:52:43.014268 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:52:43.014268 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:52:43.014268 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 30 10:52:43.014268 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 30 10:52:43.014268 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 30 10:52:43.014268 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 30 10:52:43.014268 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 30 10:52:43.014268 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 30 10:52:43.014268 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 30 10:52:43.014268 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:52:43.014268 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:52:43.014268 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:52:43.014268 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:52:43.014268 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:52:43.014268 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:52:43.014268 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 30 10:52:43.014268 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 30 10:52:43.015468 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 30 10:52:43.015468 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:52:43.015468 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-5011fdee-d611-469f-875c-207adfa44d3d tempest-VolumesNegativeTest-1028387977 tempest-VolumesNegativeTest-1028387977-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124203) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:52:43.015468 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-5011fdee-d611-469f-875c-207adfa44d3d tempest-VolumesNegativeTest-1028387977 tempest-VolumesNegativeTest-1028387977-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.011461 Jun 30 10:52:43.015468 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 574/1129] 10.222.0.59 () {60 vars in 1155 bytes} [Thu Jun 30 10:52:42 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 30 10:52:43.027152 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-50cc4d38-89f6-49cf-ae4f-f64c2503f04f tempest-VolumesNegativeTest-1028387977 tempest-VolumesNegativeTest-1028387977-project] Calling method '.version_select at 0x7f4dadd7d1f0>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:52:43.060862 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.wsgi [None req-50cc4d38-89f6-49cf-ae4f-f64c2503f04f tempest-VolumesNegativeTest-1028387977 tempest-VolumesNegativeTest-1028387977-project] HTTP exception thrown: Volume tempest-invalid-945594168 could not be found. Jun 30 10:52:43.062800 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-50cc4d38-89f6-49cf-ae4f-f64c2503f04f tempest-VolumesNegativeTest-1028387977 tempest-VolumesNegativeTest-1028387977-project] Request method failure captured: Jun 30 10:52:43.062800 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-945594168 HTTP/1.1 Jun 30 10:52:43.062800 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Accept: application/json Jun 30 10:52:43.062800 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Accept-Encoding: identity Jun 30 10:52:43.062800 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Connection: close Jun 30 10:52:43.062800 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Content-Length: 0 Jun 30 10:52:43.062800 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Content-Type: application/json Jun 30 10:52:43.062800 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Host: 10.222.0.59 Jun 30 10:52:43.062800 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Openstack-System-Scope: None Jun 30 10:52:43.062800 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: User-Agent: python-urllib3/1.26.9 Jun 30 10:52:43.062800 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Auth-Token: gAAAAABivYB6sEhxUXEVRtq16iLwM1UEBTv1yUFeSOnzasXfk6rVfRf6CIAmSWfeDl8ZD5_xkGAm58c0iSz9ap1gNTuswyvCVmniJcKYqwt9hMd4rVWPUIy6OYacGCtkEyovlNZAjGrp1hFAJtuurpbGu7_7Z1V73OXNXu1d-y2zik-vFJCKoZA Jun 30 10:52:43.062800 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Domain-Id: None Jun 30 10:52:43.062800 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Domain-Name: None Jun 30 10:52:43.062800 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Identity-Status: Confirmed Jun 30 10:52:43.062800 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Is-Admin-Project: True Jun 30 10:52:43.062800 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Domain-Id: default Jun 30 10:52:43.062800 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Domain-Name: Default Jun 30 10:52:43.062800 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Id: 01c427f452ff40b8b6eb680a23ed5ace Jun 30 10:52:43.062800 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Name: tempest-VolumesNegativeTest-1028387977 Jun 30 10:52:43.062800 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Role: member,reader Jun 30 10:52:43.062800 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Roles: member,reader Jun 30 10:52:43.064474 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/01c427f452ff40b8b6eb680a23ed5ace"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_01c427f452ff40b8b6eb680a23ed5ace"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/01c427f452ff40b8b6eb680a23ed5ace"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/01c427f452ff40b8b6eb680a23ed5ace"}]}] Jun 30 10:52:43.064474 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant: tempest-VolumesNegativeTest-1028387977 Jun 30 10:52:43.064474 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant-Id: 01c427f452ff40b8b6eb680a23ed5ace Jun 30 10:52:43.064474 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant-Name: tempest-VolumesNegativeTest-1028387977 Jun 30 10:52:43.064474 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User: tempest-VolumesNegativeTest-1028387977-project Jun 30 10:52:43.064474 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Domain-Id: default Jun 30 10:52:43.064474 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Domain-Name: Default Jun 30 10:52:43.064474 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Id: f13059803ed14f8895be3eb4ef4a638f Jun 30 10:52:43.064474 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Name: tempest-VolumesNegativeTest-1028387977-project Jun 30 10:52:43.064474 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: method: Jun 30 10:52:43.064474 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: exception: Volume tempest-invalid-945594168 could not be found. Jun 30 10:52:43.064474 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: action_args: {'id': 'tempest-invalid-945594168'} Jun 30 10:52:43.064474 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:52:43.065507 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:52:43.065507 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 10:52:43.065507 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 10:52:43.065507 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 30 10:52:43.065507 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 30 10:52:43.065507 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 30 10:52:43.065507 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 30 10:52:43.065507 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 30 10:52:43.065507 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 30 10:52:43.065507 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 30 10:52:43.065507 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 30 10:52:43.065507 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 10:52:43.065507 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 10:52:43.065507 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 10:52:43.065507 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 10:52:43.065507 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-945594168 could not be found. (HTTP 404) (Request-ID: req-5ffbfa6e-56c7-427b-a234-1443b0d9f2cd) Jun 30 10:52:43.065507 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:52:43.065507 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:52:43.065507 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:52:43.066987 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:52:43.066987 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 30 10:52:43.066987 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 30 10:52:43.066987 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 30 10:52:43.066987 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 30 10:52:43.066987 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 30 10:52:43.066987 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 30 10:52:43.066987 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 30 10:52:43.066987 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 30 10:52:43.066987 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 10:52:43.066987 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 10:52:43.066987 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 30 10:52:43.066987 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 30 10:52:43.066987 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 30 10:52:43.066987 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 30 10:52:43.066987 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 30 10:52:43.066987 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 30 10:52:43.066987 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 30 10:52:43.066987 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 30 10:52:43.068404 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 10:52:43.068404 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 10:52:43.068404 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 10:52:43.068404 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 10:52:43.068404 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-945594168 could not be found. Jun 30 10:52:43.068404 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:52:43.068404 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:52:43.068404 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:52:43.068404 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:52:43.068404 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:52:43.068404 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:52:43.068404 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:52:43.068404 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:52:43.068404 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 10:52:43.068404 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 10:52:43.068404 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:52:43.068404 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:52:43.068404 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 30 10:52:43.068404 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:52:43.068404 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-945594168 could not be found. Jun 30 10:52:43.070058 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:52:43.070058 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:52:43.070058 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:52:43.070058 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:52:43.070058 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:52:43.070058 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:52:43.070058 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:52:43.070058 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:52:43.070058 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-945594168 could not be found. Jun 30 10:52:43.070058 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:52:43.070058 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-50cc4d38-89f6-49cf-ae4f-f64c2503f04f tempest-VolumesNegativeTest-1028387977 tempest-VolumesNegativeTest-1028387977-project] Returning 404 to user: Volume tempest-invalid-945594168 could not be found. {{(pid=124204) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:52:43.070058 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-50cc4d38-89f6-49cf-ae4f-f64c2503f04f tempest-VolumesNegativeTest-1028387977 tempest-VolumesNegativeTest-1028387977-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/tempest-invalid-945594168" status: 404 len: 98 microversion: 2.1 time: 0.041606 Jun 30 10:52:43.070058 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 556/1130] 10.222.0.59 () {58 vars in 1214 bytes} [Thu Jun 30 10:52:43 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-945594168 => generated 98 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 30 10:52:43.082658 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-e92f7a3b-4ab5-4384-bb40-460d1fa2ff08 tempest-VolumesNegativeTest-1028387977 tempest-VolumesNegativeTest-1028387977-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005495 Jun 30 10:52:43.083188 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 575/1131] 10.222.0.59 () {58 vars in 1139 bytes} [Thu Jun 30 10:52:43 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 30 10:52:43.092733 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-731bb5da-e281-40ee-9a48-40ee6a53b09e tempest-VolumesNegativeTest-1028387977 tempest-VolumesNegativeTest-1028387977-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004257 Jun 30 10:52:43.093079 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 557/1132] 10.222.0.59 () {58 vars in 1136 bytes} [Thu Jun 30 10:52:43 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 30 10:52:43.103189 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-f2003716-39bc-430f-be85-85ba7a28185b tempest-VolumesNegativeTest-1028387977 tempest-VolumesNegativeTest-1028387977-project] Calling method '.version_select at 0x7f4dadd940d0>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:52:43.137147 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.wsgi [None req-f2003716-39bc-430f-be85-85ba7a28185b tempest-VolumesNegativeTest-1028387977 tempest-VolumesNegativeTest-1028387977-project] HTTP exception thrown: Volume 7e2aaa0d-e41e-4d77-a81b-4e1999357c86 could not be found. Jun 30 10:52:43.139184 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-f2003716-39bc-430f-be85-85ba7a28185b tempest-VolumesNegativeTest-1028387977 tempest-VolumesNegativeTest-1028387977-project] Request method failure captured: Jun 30 10:52:43.139184 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: request: DELETE /compute/v2.1/os-volumes/7e2aaa0d-e41e-4d77-a81b-4e1999357c86 HTTP/1.1 Jun 30 10:52:43.139184 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Accept: application/json Jun 30 10:52:43.139184 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Accept-Encoding: identity Jun 30 10:52:43.139184 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Connection: close Jun 30 10:52:43.139184 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Content-Length: 0 Jun 30 10:52:43.139184 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Content-Type: application/json Jun 30 10:52:43.139184 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Host: 10.222.0.59 Jun 30 10:52:43.139184 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Openstack-System-Scope: None Jun 30 10:52:43.139184 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: User-Agent: python-urllib3/1.26.9 Jun 30 10:52:43.139184 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Auth-Token: gAAAAABivYB6sEhxUXEVRtq16iLwM1UEBTv1yUFeSOnzasXfk6rVfRf6CIAmSWfeDl8ZD5_xkGAm58c0iSz9ap1gNTuswyvCVmniJcKYqwt9hMd4rVWPUIy6OYacGCtkEyovlNZAjGrp1hFAJtuurpbGu7_7Z1V73OXNXu1d-y2zik-vFJCKoZA Jun 30 10:52:43.139184 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Domain-Id: None Jun 30 10:52:43.139184 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Domain-Name: None Jun 30 10:52:43.139184 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Identity-Status: Confirmed Jun 30 10:52:43.139184 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Is-Admin-Project: True Jun 30 10:52:43.139184 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Domain-Id: default Jun 30 10:52:43.139184 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Domain-Name: Default Jun 30 10:52:43.139184 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Id: 01c427f452ff40b8b6eb680a23ed5ace Jun 30 10:52:43.139184 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Name: tempest-VolumesNegativeTest-1028387977 Jun 30 10:52:43.139184 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Role: member,reader Jun 30 10:52:43.139184 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Roles: member,reader Jun 30 10:52:43.140844 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/01c427f452ff40b8b6eb680a23ed5ace"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_01c427f452ff40b8b6eb680a23ed5ace"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/01c427f452ff40b8b6eb680a23ed5ace"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/01c427f452ff40b8b6eb680a23ed5ace"}]}] Jun 30 10:52:43.140844 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant: tempest-VolumesNegativeTest-1028387977 Jun 30 10:52:43.140844 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant-Id: 01c427f452ff40b8b6eb680a23ed5ace Jun 30 10:52:43.140844 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant-Name: tempest-VolumesNegativeTest-1028387977 Jun 30 10:52:43.140844 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User: tempest-VolumesNegativeTest-1028387977-project Jun 30 10:52:43.140844 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Domain-Id: default Jun 30 10:52:43.140844 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Domain-Name: Default Jun 30 10:52:43.140844 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Id: f13059803ed14f8895be3eb4ef4a638f Jun 30 10:52:43.140844 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Name: tempest-VolumesNegativeTest-1028387977-project Jun 30 10:52:43.140844 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: method: Jun 30 10:52:43.140844 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: exception: Volume 7e2aaa0d-e41e-4d77-a81b-4e1999357c86 could not be found. Jun 30 10:52:43.140844 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: action_args: {'id': '7e2aaa0d-e41e-4d77-a81b-4e1999357c86'} Jun 30 10:52:43.140844 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:52:43.141681 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:52:43.141681 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 10:52:43.141681 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 10:52:43.141681 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 30 10:52:43.141681 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 30 10:52:43.141681 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 30 10:52:43.141681 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 30 10:52:43.141681 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 30 10:52:43.141681 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 30 10:52:43.141681 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 30 10:52:43.141681 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 30 10:52:43.141681 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 10:52:43.141681 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 10:52:43.141681 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 10:52:43.141681 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 10:52:43.141681 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7e2aaa0d-e41e-4d77-a81b-4e1999357c86 could not be found. (HTTP 404) (Request-ID: req-5ece5d9a-46af-4951-baf7-8fdc8c9675da) Jun 30 10:52:43.141681 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:52:43.141681 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:52:43.141681 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:52:43.142828 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:52:43.142828 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 30 10:52:43.142828 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 30 10:52:43.142828 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 30 10:52:43.142828 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 30 10:52:43.142828 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 30 10:52:43.142828 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 30 10:52:43.142828 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 30 10:52:43.142828 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 30 10:52:43.142828 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 10:52:43.142828 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 10:52:43.142828 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 30 10:52:43.142828 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 30 10:52:43.142828 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 30 10:52:43.142828 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 30 10:52:43.142828 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 30 10:52:43.142828 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 30 10:52:43.142828 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 30 10:52:43.142828 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 30 10:52:43.144125 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 10:52:43.144125 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 10:52:43.144125 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 10:52:43.144125 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 10:52:43.144125 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7e2aaa0d-e41e-4d77-a81b-4e1999357c86 could not be found. Jun 30 10:52:43.144125 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:52:43.144125 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:52:43.144125 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:52:43.144125 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:52:43.144125 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:52:43.144125 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:52:43.144125 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:52:43.144125 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:52:43.144125 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 10:52:43.144125 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 10:52:43.144125 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:52:43.144125 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:52:43.144125 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 30 10:52:43.144125 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:52:43.145399 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7e2aaa0d-e41e-4d77-a81b-4e1999357c86 could not be found. Jun 30 10:52:43.145399 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:52:43.145399 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:52:43.145399 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:52:43.145399 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:52:43.145399 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:52:43.145399 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:52:43.145399 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:52:43.145399 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:52:43.145399 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7e2aaa0d-e41e-4d77-a81b-4e1999357c86 could not be found. Jun 30 10:52:43.145399 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:52:43.147648 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-f2003716-39bc-430f-be85-85ba7a28185b tempest-VolumesNegativeTest-1028387977 tempest-VolumesNegativeTest-1028387977-project] Returning 404 to user: Volume 7e2aaa0d-e41e-4d77-a81b-4e1999357c86 could not be found. {{(pid=124203) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:52:43.148531 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-f2003716-39bc-430f-be85-85ba7a28185b tempest-VolumesNegativeTest-1028387977 tempest-VolumesNegativeTest-1028387977-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/7e2aaa0d-e41e-4d77-a81b-4e1999357c86" status: 404 len: 109 microversion: 2.1 time: 0.049169 Jun 30 10:52:43.149081 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 576/1133] 10.222.0.59 () {58 vars in 1247 bytes} [Thu Jun 30 10:52:43 2022] DELETE /compute/v2.1/os-volumes/7e2aaa0d-e41e-4d77-a81b-4e1999357c86 => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 10:52:43.159878 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-a79d2c68-37de-48ba-b8e1-f451db130979 tempest-VolumesNegativeTest-1028387977 tempest-VolumesNegativeTest-1028387977-project] Calling method '.version_select at 0x7f4dade3c940>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:52:43.187444 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.wsgi [None req-a79d2c68-37de-48ba-b8e1-f451db130979 tempest-VolumesNegativeTest-1028387977 tempest-VolumesNegativeTest-1028387977-project] HTTP exception thrown: Volume d4139218-aa4c-4751-b137-4006d6ebdd4c could not be found. Jun 30 10:52:43.189509 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-a79d2c68-37de-48ba-b8e1-f451db130979 tempest-VolumesNegativeTest-1028387977 tempest-VolumesNegativeTest-1028387977-project] Request method failure captured: Jun 30 10:52:43.189509 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: request: GET /compute/v2.1/os-volumes/d4139218-aa4c-4751-b137-4006d6ebdd4c HTTP/1.1 Jun 30 10:52:43.189509 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Accept: application/json Jun 30 10:52:43.189509 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Accept-Encoding: identity Jun 30 10:52:43.189509 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Connection: close Jun 30 10:52:43.189509 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Content-Length: 0 Jun 30 10:52:43.189509 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Content-Type: application/json Jun 30 10:52:43.189509 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Host: 10.222.0.59 Jun 30 10:52:43.189509 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Openstack-System-Scope: None Jun 30 10:52:43.189509 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: User-Agent: python-urllib3/1.26.9 Jun 30 10:52:43.189509 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Auth-Token: gAAAAABivYB6sEhxUXEVRtq16iLwM1UEBTv1yUFeSOnzasXfk6rVfRf6CIAmSWfeDl8ZD5_xkGAm58c0iSz9ap1gNTuswyvCVmniJcKYqwt9hMd4rVWPUIy6OYacGCtkEyovlNZAjGrp1hFAJtuurpbGu7_7Z1V73OXNXu1d-y2zik-vFJCKoZA Jun 30 10:52:43.189509 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Domain-Id: None Jun 30 10:52:43.189509 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Domain-Name: None Jun 30 10:52:43.189509 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Identity-Status: Confirmed Jun 30 10:52:43.189509 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Is-Admin-Project: True Jun 30 10:52:43.189509 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Domain-Id: default Jun 30 10:52:43.189509 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Domain-Name: Default Jun 30 10:52:43.189509 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Id: 01c427f452ff40b8b6eb680a23ed5ace Jun 30 10:52:43.189509 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Name: tempest-VolumesNegativeTest-1028387977 Jun 30 10:52:43.189509 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Role: member,reader Jun 30 10:52:43.189509 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Roles: member,reader Jun 30 10:52:43.190820 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/01c427f452ff40b8b6eb680a23ed5ace"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_01c427f452ff40b8b6eb680a23ed5ace"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/01c427f452ff40b8b6eb680a23ed5ace"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/01c427f452ff40b8b6eb680a23ed5ace"}]}] Jun 30 10:52:43.190820 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant: tempest-VolumesNegativeTest-1028387977 Jun 30 10:52:43.190820 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant-Id: 01c427f452ff40b8b6eb680a23ed5ace Jun 30 10:52:43.190820 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant-Name: tempest-VolumesNegativeTest-1028387977 Jun 30 10:52:43.190820 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User: tempest-VolumesNegativeTest-1028387977-project Jun 30 10:52:43.190820 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Domain-Id: default Jun 30 10:52:43.190820 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Domain-Name: Default Jun 30 10:52:43.190820 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Id: f13059803ed14f8895be3eb4ef4a638f Jun 30 10:52:43.190820 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Name: tempest-VolumesNegativeTest-1028387977-project Jun 30 10:52:43.190820 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: method: Jun 30 10:52:43.190820 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: exception: Volume d4139218-aa4c-4751-b137-4006d6ebdd4c could not be found. Jun 30 10:52:43.190820 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: action_args: {'id': 'd4139218-aa4c-4751-b137-4006d6ebdd4c'} Jun 30 10:52:43.190820 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:52:43.191763 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:52:43.191763 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 10:52:43.191763 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 10:52:43.191763 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 30 10:52:43.191763 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 30 10:52:43.191763 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 30 10:52:43.191763 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 30 10:52:43.191763 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 10:52:43.191763 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 10:52:43.191763 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 10:52:43.191763 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 10:52:43.191763 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 10:52:43.191763 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 10:52:43.191763 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 10:52:43.191763 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 10:52:43.191763 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d4139218-aa4c-4751-b137-4006d6ebdd4c could not be found. (HTTP 404) (Request-ID: req-38eb18ce-4aad-4c75-ad0c-f4cdb52c9942) Jun 30 10:52:43.191763 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:52:43.191763 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:52:43.191763 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:52:43.193365 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:52:43.193365 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 30 10:52:43.193365 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 30 10:52:43.193365 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 30 10:52:43.193365 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 30 10:52:43.193365 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 30 10:52:43.193365 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 30 10:52:43.193365 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 30 10:52:43.193365 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 30 10:52:43.193365 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 10:52:43.193365 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 10:52:43.193365 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 30 10:52:43.193365 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 30 10:52:43.193365 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 30 10:52:43.193365 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 30 10:52:43.193365 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 10:52:43.193365 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 10:52:43.193365 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 10:52:43.193365 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 10:52:43.194712 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 10:52:43.194712 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 10:52:43.194712 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 10:52:43.194712 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 10:52:43.194712 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d4139218-aa4c-4751-b137-4006d6ebdd4c could not be found. Jun 30 10:52:43.194712 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:52:43.194712 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:52:43.194712 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:52:43.194712 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:52:43.194712 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:52:43.194712 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:52:43.194712 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:52:43.194712 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:52:43.194712 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 10:52:43.194712 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 10:52:43.194712 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:52:43.194712 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:52:43.194712 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 30 10:52:43.194712 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:52:43.196042 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d4139218-aa4c-4751-b137-4006d6ebdd4c could not be found. Jun 30 10:52:43.196042 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:52:43.196042 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:52:43.196042 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:52:43.196042 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:52:43.196042 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:52:43.196042 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:52:43.196042 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:52:43.196042 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:52:43.196042 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d4139218-aa4c-4751-b137-4006d6ebdd4c could not be found. Jun 30 10:52:43.196042 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:52:43.196042 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-a79d2c68-37de-48ba-b8e1-f451db130979 tempest-VolumesNegativeTest-1028387977 tempest-VolumesNegativeTest-1028387977-project] Returning 404 to user: Volume d4139218-aa4c-4751-b137-4006d6ebdd4c could not be found. {{(pid=124204) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:52:43.196042 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-a79d2c68-37de-48ba-b8e1-f451db130979 tempest-VolumesNegativeTest-1028387977 tempest-VolumesNegativeTest-1028387977-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/d4139218-aa4c-4751-b137-4006d6ebdd4c" status: 404 len: 109 microversion: 2.1 time: 0.035321 Jun 30 10:52:43.196042 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 558/1134] 10.222.0.59 () {58 vars in 1244 bytes} [Thu Jun 30 10:52:43 2022] GET /compute/v2.1/os-volumes/d4139218-aa4c-4751-b137-4006d6ebdd4c => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 10:53:01.637823 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=1 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:53:01.639131 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_cell1:SELECT=15 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:53:01.643954 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-dc0f00f8-d42e-4df9-8899-f74281e08350 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1763569237", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1596741002", "security_groups": [{"name": "tempest-secgroup-smoke-3232495"}], "networks": [{"uuid": "9717cc7c-e5fe-4c48-999c-219728db41f0"}], "block_device_mapping_v2": [{"uuid": "f0608768-2253-4dfa-9ba5-e31c8f335209", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:53:01.754800 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.network.neutron [None req-dc0f00f8-d42e-4df9-8899-f74281e08350 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] validate_networks() for [('9717cc7c-e5fe-4c48-999c-219728db41f0', None, None, None, None, None)] {{(pid=124203) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 10:53:02.205202 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.virt.hardware [None req-dc0f00f8-d42e-4df9-8899-f74281e08350 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Flavor limits 0:0:0 {{(pid=124203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 10:53:02.205629 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.virt.hardware [None req-dc0f00f8-d42e-4df9-8899-f74281e08350 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Image limits 0:0:0 {{(pid=124203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 10:53:02.206102 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.virt.hardware [None req-dc0f00f8-d42e-4df9-8899-f74281e08350 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Flavor pref 0:0:0 {{(pid=124203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 10:53:02.206536 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.virt.hardware [None req-dc0f00f8-d42e-4df9-8899-f74281e08350 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Image pref 0:0:0 {{(pid=124203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 10:53:02.206942 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.virt.hardware [None req-dc0f00f8-d42e-4df9-8899-f74281e08350 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 10:53:02.215733 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-dc0f00f8-d42e-4df9-8899-f74281e08350 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:53:02.216707 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-dc0f00f8-d42e-4df9-8899-f74281e08350 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:53:02.217501 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-dc0f00f8-d42e-4df9-8899-f74281e08350 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:53:02.217933 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-dc0f00f8-d42e-4df9-8899-f74281e08350 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:53:02.235982 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.quota [None req-dc0f00f8-d42e-4df9-8899-f74281e08350 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Getting quotas for project 8819274ed13f4f3f848fb7be9e295815. Resources: {'instances', 'cores', 'ram'} {{(pid=124203) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 10:53:02.239903 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.quota [None req-dc0f00f8-d42e-4df9-8899-f74281e08350 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Getting quotas for user 8453bd18330b40af9efac8d72d749141 and project 8819274ed13f4f3f848fb7be9e295815. Resources: {'instances', 'cores', 'ram'} {{(pid=124203) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 10:53:02.297751 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-dc0f00f8-d42e-4df9-8899-f74281e08350 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Going to run 1 instances... {{(pid=124203) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 10:53:02.299892 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-dc0f00f8-d42e-4df9-8899-f74281e08350 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] [instance: 9db253f7-5a9a-4f18-a021-a6305874dd1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f0608768-2253-4dfa-9ba5-e31c8f335209',volume_size=None,volume_type=None)] {{(pid=124203) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 10:53:02.433158 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-dc0f00f8-d42e-4df9-8899-f74281e08350 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.796866 Jun 30 10:53:02.438853 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 577/1135] 10.222.0.59 () {60 vars in 1146 bytes} [Thu Jun 30 10:53:01 2022] POST /compute/v2.1/servers => generated 403 bytes in 798 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 10:53:02.440936 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_cell0:SELECT=4 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:53:02.442299 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=1 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:53:02.443021 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:53:02.448354 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-5d0807ed-d1cc-4286-b870-8bfc5ca225e5 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:53:02.448990 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-5d0807ed-d1cc-4286-b870-8bfc5ca225e5 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] [instance: 9db253f7-5a9a-4f18-a021-a6305874dd1f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:53:02.510986 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-5d0807ed-d1cc-4286-b870-8bfc5ca225e5 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8453bd18330b40af9efac8d72d749141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8819274ed13f4f3f848fb7be9e295815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:53:02.518382 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-5d0807ed-d1cc-4286-b870-8bfc5ca225e5 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] 10.222.0.59 "GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f" status: 200 len: 1089 microversion: 2.1 time: 0.078116 Jun 30 10:53:02.518945 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 559/1136] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:53:02 2022] GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f => generated 1089 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:53:03.535821 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-9d9b8698-db00-494f-bcf0-539fa026c5fb tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:53:03.537162 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-9d9b8698-db00-494f-bcf0-539fa026c5fb tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] [instance: 9db253f7-5a9a-4f18-a021-a6305874dd1f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:53:03.543896 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-9d9b8698-db00-494f-bcf0-539fa026c5fb tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:53:03.545235 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-9d9b8698-db00-494f-bcf0-539fa026c5fb tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:53:03.546114 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-9d9b8698-db00-494f-bcf0-539fa026c5fb tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:53:03.546781 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-9d9b8698-db00-494f-bcf0-539fa026c5fb tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:53:03.623487 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-9d9b8698-db00-494f-bcf0-539fa026c5fb tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8453bd18330b40af9efac8d72d749141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8819274ed13f4f3f848fb7be9e295815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:53:03.636890 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-9d9b8698-db00-494f-bcf0-539fa026c5fb tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] 10.222.0.59 "GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f" status: 200 len: 1205 microversion: 2.1 time: 0.105382 Jun 30 10:53:03.637654 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 578/1137] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:53:03 2022] GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f => generated 1205 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:53:04.654470 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-51dd98f0-a51a-44b8-8b95-4ee7c4b298dd tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:53:04.655317 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-51dd98f0-a51a-44b8-8b95-4ee7c4b298dd tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] [instance: 9db253f7-5a9a-4f18-a021-a6305874dd1f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:53:04.661923 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-51dd98f0-a51a-44b8-8b95-4ee7c4b298dd tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:53:04.662485 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-51dd98f0-a51a-44b8-8b95-4ee7c4b298dd tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:53:04.663330 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-51dd98f0-a51a-44b8-8b95-4ee7c4b298dd tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:53:04.664003 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-51dd98f0-a51a-44b8-8b95-4ee7c4b298dd tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:53:04.860306 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-51dd98f0-a51a-44b8-8b95-4ee7c4b298dd tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8453bd18330b40af9efac8d72d749141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8819274ed13f4f3f848fb7be9e295815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:53:04.870505 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-51dd98f0-a51a-44b8-8b95-4ee7c4b298dd tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] 10.222.0.59 "GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f" status: 200 len: 1258 microversion: 2.1 time: 0.220230 Jun 30 10:53:04.871603 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 560/1138] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:53:04 2022] GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f => generated 1258 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:53:05.003569 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [req-8db8162c-47f1-4ccc-a078-51552908f106 req-14cecb0f-57d4-47ce-ae5b-333478122170 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9db253f7-5a9a-4f18-a021-a6305874dd1f", "tag": "9f40ae69-a624-4d1b-be54-aa13e5735312"}]} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:53:05.036917 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-8db8162c-47f1-4ccc-a078-51552908f106 req-14cecb0f-57d4-47ce-ae5b-333478122170 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:53:05.037242 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-8db8162c-47f1-4ccc-a078-51552908f106 req-14cecb0f-57d4-47ce-ae5b-333478122170 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:53:05.051622 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.compute.server_external_events [req-8db8162c-47f1-4ccc-a078-51552908f106 req-14cecb0f-57d4-47ce-ae5b-333478122170 service nova] Creating event network-changed:9f40ae69-a624-4d1b-be54-aa13e5735312 for instance 9db253f7-5a9a-4f18-a021-a6305874dd1f on hv-cinder-82282 Jun 30 10:53:05.059922 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [req-8db8162c-47f1-4ccc-a078-51552908f106 req-14cecb0f-57d4-47ce-ae5b-333478122170 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064746 Jun 30 10:53:05.061537 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 579/1139] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:53:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:53:05.887123 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-692cf1ba-50e6-431f-824a-b56da673725a tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:53:05.887771 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-692cf1ba-50e6-431f-824a-b56da673725a tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] [instance: 9db253f7-5a9a-4f18-a021-a6305874dd1f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:53:05.894197 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-692cf1ba-50e6-431f-824a-b56da673725a tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:53:05.894641 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-692cf1ba-50e6-431f-824a-b56da673725a tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:53:05.895459 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-692cf1ba-50e6-431f-824a-b56da673725a tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:53:05.895827 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-692cf1ba-50e6-431f-824a-b56da673725a tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:53:06.030110 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-692cf1ba-50e6-431f-824a-b56da673725a tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8453bd18330b40af9efac8d72d749141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8819274ed13f4f3f848fb7be9e295815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:53:06.038537 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-692cf1ba-50e6-431f-824a-b56da673725a tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] 10.222.0.59 "GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f" status: 200 len: 1258 microversion: 2.1 time: 0.155158 Jun 30 10:53:06.039626 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 561/1140] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:53:05 2022] GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:53:07.056930 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-1dc9e151-1c4e-4a9d-8366-e63491cf4f64 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:53:07.057553 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-1dc9e151-1c4e-4a9d-8366-e63491cf4f64 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] [instance: 9db253f7-5a9a-4f18-a021-a6305874dd1f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:53:07.063912 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-1dc9e151-1c4e-4a9d-8366-e63491cf4f64 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:53:07.064364 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-1dc9e151-1c4e-4a9d-8366-e63491cf4f64 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:53:07.065186 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-1dc9e151-1c4e-4a9d-8366-e63491cf4f64 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:53:07.065623 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-1dc9e151-1c4e-4a9d-8366-e63491cf4f64 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:53:07.202576 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-1dc9e151-1c4e-4a9d-8366-e63491cf4f64 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8453bd18330b40af9efac8d72d749141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8819274ed13f4f3f848fb7be9e295815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:53:07.210379 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-1dc9e151-1c4e-4a9d-8366-e63491cf4f64 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] 10.222.0.59 "GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f" status: 200 len: 1258 microversion: 2.1 time: 0.157990 Jun 30 10:53:07.210873 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 580/1141] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:53:07 2022] GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f => generated 1258 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:53:08.227099 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-d2f34470-ef7b-4e20-863b-efe736b8447b tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:53:08.227711 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-d2f34470-ef7b-4e20-863b-efe736b8447b tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] [instance: 9db253f7-5a9a-4f18-a021-a6305874dd1f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:53:08.235683 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d2f34470-ef7b-4e20-863b-efe736b8447b tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:53:08.236278 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d2f34470-ef7b-4e20-863b-efe736b8447b tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:53:08.237150 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d2f34470-ef7b-4e20-863b-efe736b8447b tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:53:08.237682 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d2f34470-ef7b-4e20-863b-efe736b8447b tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:53:08.369715 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-d2f34470-ef7b-4e20-863b-efe736b8447b tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8453bd18330b40af9efac8d72d749141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8819274ed13f4f3f848fb7be9e295815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:53:08.377789 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-d2f34470-ef7b-4e20-863b-efe736b8447b tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] 10.222.0.59 "GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f" status: 200 len: 1258 microversion: 2.1 time: 0.154539 Jun 30 10:53:08.378362 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 562/1142] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:53:08 2022] GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f => generated 1258 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:53:09.394487 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-865c180a-0b2a-40d7-8899-6c4d353319ba tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:53:09.395096 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-865c180a-0b2a-40d7-8899-6c4d353319ba tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] [instance: 9db253f7-5a9a-4f18-a021-a6305874dd1f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:53:09.401523 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-865c180a-0b2a-40d7-8899-6c4d353319ba tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:53:09.401960 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-865c180a-0b2a-40d7-8899-6c4d353319ba tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:53:09.402709 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-865c180a-0b2a-40d7-8899-6c4d353319ba tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:53:09.403137 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-865c180a-0b2a-40d7-8899-6c4d353319ba tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:53:09.536341 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-865c180a-0b2a-40d7-8899-6c4d353319ba tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8453bd18330b40af9efac8d72d749141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8819274ed13f4f3f848fb7be9e295815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:53:09.544005 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-865c180a-0b2a-40d7-8899-6c4d353319ba tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] 10.222.0.59 "GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f" status: 200 len: 1258 microversion: 2.1 time: 0.153383 Jun 30 10:53:09.545116 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 581/1143] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:53:09 2022] GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f => generated 1258 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:53:10.561196 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-55aa503c-eaba-4379-bacd-72d6625595c5 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:53:10.561739 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-55aa503c-eaba-4379-bacd-72d6625595c5 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] [instance: 9db253f7-5a9a-4f18-a021-a6305874dd1f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:53:10.568114 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-55aa503c-eaba-4379-bacd-72d6625595c5 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:53:10.568581 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-55aa503c-eaba-4379-bacd-72d6625595c5 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:53:10.569334 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-55aa503c-eaba-4379-bacd-72d6625595c5 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:53:10.569844 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-55aa503c-eaba-4379-bacd-72d6625595c5 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:53:10.703314 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-55aa503c-eaba-4379-bacd-72d6625595c5 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8453bd18330b40af9efac8d72d749141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8819274ed13f4f3f848fb7be9e295815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:53:10.710684 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-55aa503c-eaba-4379-bacd-72d6625595c5 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] 10.222.0.59 "GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f" status: 200 len: 1258 microversion: 2.1 time: 0.154109 Jun 30 10:53:10.711252 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 563/1144] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:53:10 2022] GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f => generated 1258 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:53:11.729474 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-02b6470f-9aec-4457-9917-95681003fdfb tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:53:11.730114 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-02b6470f-9aec-4457-9917-95681003fdfb tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] [instance: 9db253f7-5a9a-4f18-a021-a6305874dd1f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:53:11.736646 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-02b6470f-9aec-4457-9917-95681003fdfb tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:53:11.737097 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-02b6470f-9aec-4457-9917-95681003fdfb tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:53:11.737862 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-02b6470f-9aec-4457-9917-95681003fdfb tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:53:11.738485 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-02b6470f-9aec-4457-9917-95681003fdfb tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:53:11.870724 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-02b6470f-9aec-4457-9917-95681003fdfb tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8453bd18330b40af9efac8d72d749141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8819274ed13f4f3f848fb7be9e295815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:53:11.878804 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-02b6470f-9aec-4457-9917-95681003fdfb tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] 10.222.0.59 "GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f" status: 200 len: 1258 microversion: 2.1 time: 0.155744 Jun 30 10:53:11.879369 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 582/1145] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:53:11 2022] GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:53:12.895381 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-3093a9e5-a49d-46ba-bce0-7c6b7bf4098e tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:53:12.896805 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-3093a9e5-a49d-46ba-bce0-7c6b7bf4098e tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] [instance: 9db253f7-5a9a-4f18-a021-a6305874dd1f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:53:12.899213 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_cell0:SELECT=2 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:53:12.905292 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-3093a9e5-a49d-46ba-bce0-7c6b7bf4098e tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:53:12.905739 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-3093a9e5-a49d-46ba-bce0-7c6b7bf4098e tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:53:12.906513 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-3093a9e5-a49d-46ba-bce0-7c6b7bf4098e tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:53:12.906950 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-3093a9e5-a49d-46ba-bce0-7c6b7bf4098e tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:53:13.038991 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-3093a9e5-a49d-46ba-bce0-7c6b7bf4098e tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8453bd18330b40af9efac8d72d749141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8819274ed13f4f3f848fb7be9e295815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:53:13.046523 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-3093a9e5-a49d-46ba-bce0-7c6b7bf4098e tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] 10.222.0.59 "GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f" status: 200 len: 1258 microversion: 2.1 time: 0.155075 Jun 30 10:53:13.047128 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 564/1146] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:53:12 2022] GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f => generated 1258 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:53:14.063670 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-bd6e0e1e-82bd-403a-8774-31d4b5050ca8 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:53:14.064279 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-bd6e0e1e-82bd-403a-8774-31d4b5050ca8 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] [instance: 9db253f7-5a9a-4f18-a021-a6305874dd1f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:53:14.066260 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_cell0:SELECT=2 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:53:14.067082 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_cell0:SELECT=6 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:53:14.073330 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-bd6e0e1e-82bd-403a-8774-31d4b5050ca8 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:53:14.073774 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-bd6e0e1e-82bd-403a-8774-31d4b5050ca8 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:53:14.074526 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-bd6e0e1e-82bd-403a-8774-31d4b5050ca8 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:53:14.074959 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-bd6e0e1e-82bd-403a-8774-31d4b5050ca8 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:53:14.207392 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-bd6e0e1e-82bd-403a-8774-31d4b5050ca8 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8453bd18330b40af9efac8d72d749141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8819274ed13f4f3f848fb7be9e295815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:53:14.214821 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-bd6e0e1e-82bd-403a-8774-31d4b5050ca8 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] 10.222.0.59 "GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f" status: 200 len: 1258 microversion: 2.1 time: 0.155662 Jun 30 10:53:14.215400 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 583/1147] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:53:14 2022] GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:53:15.232931 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-7e69839c-8e38-49af-84bb-27217266d0d2 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:53:15.233549 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-7e69839c-8e38-49af-84bb-27217266d0d2 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] [instance: 9db253f7-5a9a-4f18-a021-a6305874dd1f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:53:15.240312 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-7e69839c-8e38-49af-84bb-27217266d0d2 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:53:15.240795 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-7e69839c-8e38-49af-84bb-27217266d0d2 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:53:15.241559 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-7e69839c-8e38-49af-84bb-27217266d0d2 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:53:15.241996 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-7e69839c-8e38-49af-84bb-27217266d0d2 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:53:15.377474 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-7e69839c-8e38-49af-84bb-27217266d0d2 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8453bd18330b40af9efac8d72d749141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8819274ed13f4f3f848fb7be9e295815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:53:15.384969 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-7e69839c-8e38-49af-84bb-27217266d0d2 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] 10.222.0.59 "GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f" status: 200 len: 1258 microversion: 2.1 time: 0.156459 Jun 30 10:53:15.385536 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 565/1148] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:53:15 2022] GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f => generated 1258 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:53:16.005776 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [req-f85d2107-f339-40a9-859e-421ebe722cf4 req-ad3472e7-6c8d-469a-b2bb-554ef27f4f25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9db253f7-5a9a-4f18-a021-a6305874dd1f", "name": "network-vif-plugged", "status": "completed", "tag": "9f40ae69-a624-4d1b-be54-aa13e5735312"}]} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:53:16.013736 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-f85d2107-f339-40a9-859e-421ebe722cf4 req-ad3472e7-6c8d-469a-b2bb-554ef27f4f25 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:53:16.014184 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-f85d2107-f339-40a9-859e-421ebe722cf4 req-ad3472e7-6c8d-469a-b2bb-554ef27f4f25 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:53:16.025079 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.compute.server_external_events [req-f85d2107-f339-40a9-859e-421ebe722cf4 req-ad3472e7-6c8d-469a-b2bb-554ef27f4f25 service nova] Creating event network-vif-plugged:9f40ae69-a624-4d1b-be54-aa13e5735312 for instance 9db253f7-5a9a-4f18-a021-a6305874dd1f on hv-cinder-82282 Jun 30 10:53:16.030110 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [req-f85d2107-f339-40a9-859e-421ebe722cf4 req-ad3472e7-6c8d-469a-b2bb-554ef27f4f25 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154232 Jun 30 10:53:16.030867 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 584/1149] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:53:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 10:53:16.401489 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-a45d5cbf-2bec-4d12-92ab-a762afc1bce4 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:53:16.402098 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-a45d5cbf-2bec-4d12-92ab-a762afc1bce4 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] [instance: 9db253f7-5a9a-4f18-a021-a6305874dd1f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:53:16.409119 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a45d5cbf-2bec-4d12-92ab-a762afc1bce4 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:53:16.409562 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a45d5cbf-2bec-4d12-92ab-a762afc1bce4 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:53:16.410317 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a45d5cbf-2bec-4d12-92ab-a762afc1bce4 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:53:16.410748 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a45d5cbf-2bec-4d12-92ab-a762afc1bce4 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:53:16.538817 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-a45d5cbf-2bec-4d12-92ab-a762afc1bce4 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8453bd18330b40af9efac8d72d749141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8819274ed13f4f3f848fb7be9e295815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:53:16.546849 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-a45d5cbf-2bec-4d12-92ab-a762afc1bce4 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] 10.222.0.59 "GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f" status: 200 len: 1258 microversion: 2.1 time: 0.149258 Jun 30 10:53:16.547417 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 566/1150] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:53:16 2022] GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f => generated 1258 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:53:17.564706 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-4b2026c1-c32b-4b79-b5ce-f868bd7e7633 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:53:17.565318 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-4b2026c1-c32b-4b79-b5ce-f868bd7e7633 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] [instance: 9db253f7-5a9a-4f18-a021-a6305874dd1f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:53:17.572759 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-4b2026c1-c32b-4b79-b5ce-f868bd7e7633 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:53:17.573391 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-4b2026c1-c32b-4b79-b5ce-f868bd7e7633 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:53:17.574171 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-4b2026c1-c32b-4b79-b5ce-f868bd7e7633 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:53:17.574611 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-4b2026c1-c32b-4b79-b5ce-f868bd7e7633 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:53:17.719222 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-4b2026c1-c32b-4b79-b5ce-f868bd7e7633 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8453bd18330b40af9efac8d72d749141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8819274ed13f4f3f848fb7be9e295815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:53:17.726679 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-4b2026c1-c32b-4b79-b5ce-f868bd7e7633 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] 10.222.0.59 "GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f" status: 200 len: 1258 microversion: 2.1 time: 0.167005 Jun 30 10:53:17.727268 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 585/1151] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:53:17 2022] GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f => generated 1258 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:53:18.744651 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-22edb9d1-c899-4b38-a208-d1822c5e85b1 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:53:18.745416 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-22edb9d1-c899-4b38-a208-d1822c5e85b1 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] [instance: 9db253f7-5a9a-4f18-a021-a6305874dd1f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:53:18.752035 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-22edb9d1-c899-4b38-a208-d1822c5e85b1 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:53:18.752480 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-22edb9d1-c899-4b38-a208-d1822c5e85b1 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:53:18.753424 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-22edb9d1-c899-4b38-a208-d1822c5e85b1 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:53:18.753863 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-22edb9d1-c899-4b38-a208-d1822c5e85b1 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:53:18.881492 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-22edb9d1-c899-4b38-a208-d1822c5e85b1 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8453bd18330b40af9efac8d72d749141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8819274ed13f4f3f848fb7be9e295815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:53:18.888898 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-22edb9d1-c899-4b38-a208-d1822c5e85b1 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] 10.222.0.59 "GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f" status: 200 len: 1443 microversion: 2.1 time: 0.148108 Jun 30 10:53:18.889465 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 567/1152] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:53:18 2022] GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f => generated 1443 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:53:18.905390 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-5ae61aab-0a94-4640-b7c4-9323e9c40da4 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:53:18.906038 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-5ae61aab-0a94-4640-b7c4-9323e9c40da4 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] [instance: 9db253f7-5a9a-4f18-a021-a6305874dd1f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:53:18.912494 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-5ae61aab-0a94-4640-b7c4-9323e9c40da4 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:53:18.912978 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-5ae61aab-0a94-4640-b7c4-9323e9c40da4 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:53:18.913743 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-5ae61aab-0a94-4640-b7c4-9323e9c40da4 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:53:18.914185 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-5ae61aab-0a94-4640-b7c4-9323e9c40da4 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:53:19.042699 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-5ae61aab-0a94-4640-b7c4-9323e9c40da4 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8453bd18330b40af9efac8d72d749141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8819274ed13f4f3f848fb7be9e295815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:53:19.050236 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-5ae61aab-0a94-4640-b7c4-9323e9c40da4 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] 10.222.0.59 "GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f" status: 200 len: 1443 microversion: 2.1 time: 0.149315 Jun 30 10:53:19.050783 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 586/1153] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:53:18 2022] GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f => generated 1443 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:53:20.970505 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [req-86b90e78-c0b2-4503-9abc-73a396bf5dd5 req-ae8afa0a-2466-4898-82b4-d7d797738eb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9db253f7-5a9a-4f18-a021-a6305874dd1f", "tag": "9f40ae69-a624-4d1b-be54-aa13e5735312"}]} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:53:20.979396 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-86b90e78-c0b2-4503-9abc-73a396bf5dd5 req-ae8afa0a-2466-4898-82b4-d7d797738eb0 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:53:20.979844 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-86b90e78-c0b2-4503-9abc-73a396bf5dd5 req-ae8afa0a-2466-4898-82b4-d7d797738eb0 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:53:20.990920 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.compute.server_external_events [req-86b90e78-c0b2-4503-9abc-73a396bf5dd5 req-ae8afa0a-2466-4898-82b4-d7d797738eb0 service nova] Creating event network-changed:9f40ae69-a624-4d1b-be54-aa13e5735312 for instance 9db253f7-5a9a-4f18-a021-a6305874dd1f on hv-cinder-82282 Jun 30 10:53:20.995931 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [req-86b90e78-c0b2-4503-9abc-73a396bf5dd5 req-ae8afa0a-2466-4898-82b4-d7d797738eb0 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088959 Jun 30 10:53:20.996557 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 568/1154] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:53:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:53:36.400656 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-9f1937b7-906b-4db8-8778-d85829f6048f tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2124632173"}} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:53:36.401221 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-9f1937b7-906b-4db8-8778-d85829f6048f tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] [instance: 6526331b-07d9-4ae7-8429-187bf752923d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:53:36.404401 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:53:36.405086 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_cell1:SELECT=48 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:53:36.411294 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-9f1937b7-906b-4db8-8778-d85829f6048f tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:53:36.411738 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-9f1937b7-906b-4db8-8778-d85829f6048f tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:53:36.412496 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-9f1937b7-906b-4db8-8778-d85829f6048f tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:53:36.412954 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-9f1937b7-906b-4db8-8778-d85829f6048f tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:53:36.535233 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.network.security_group_api [None req-9f1937b7-906b-4db8-8778-d85829f6048f tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Removing security group 42d7631c-8307-4dae-aee3-cdaaebe0a7af from port 1ba7efd4-5bb9-4ada-b21b-02272e12a627 Jun 30 10:53:36.863698 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-9f1937b7-906b-4db8-8778-d85829f6048f tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] 10.222.0.59 "POST /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d/action" status: 202 len: 0 microversion: 2.1 time: 0.466845 Jun 30 10:53:36.867616 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 587/1155] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Jun 30 10:53:36 2022] POST /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d/action => generated 0 bytes in 468 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 10:53:36.873556 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_api:SELECT=22 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:53:36.875076 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_cell1:SELECT=50 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:53:36.882723 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [req-40bd9125-20ff-4d4c-a7b5-b172faf884e8 req-542caae2-0608-4715-adfa-2fb53d6c9d32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6526331b-07d9-4ae7-8429-187bf752923d", "tag": "1ba7efd4-5bb9-4ada-b21b-02272e12a627"}]} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:53:36.896764 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-40bd9125-20ff-4d4c-a7b5-b172faf884e8 req-542caae2-0608-4715-adfa-2fb53d6c9d32 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:53:36.898089 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-40bd9125-20ff-4d4c-a7b5-b172faf884e8 req-542caae2-0608-4715-adfa-2fb53d6c9d32 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:53:36.927687 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.compute.server_external_events [req-40bd9125-20ff-4d4c-a7b5-b172faf884e8 req-542caae2-0608-4715-adfa-2fb53d6c9d32 service nova] Creating event network-changed:1ba7efd4-5bb9-4ada-b21b-02272e12a627 for instance 6526331b-07d9-4ae7-8429-187bf752923d on hv-cinder-82282 Jun 30 10:53:36.935014 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [req-40bd9125-20ff-4d4c-a7b5-b172faf884e8 req-542caae2-0608-4715-adfa-2fb53d6c9d32 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063683 Jun 30 10:53:36.936098 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 569/1156] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:53:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:53:38.110010 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-529eb4dd-144a-49ef-a032-959c9905396e tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:53:38.110531 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-529eb4dd-144a-49ef-a032-959c9905396e tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] [instance: 6526331b-07d9-4ae7-8429-187bf752923d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:53:38.116884 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-529eb4dd-144a-49ef-a032-959c9905396e tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:53:38.117325 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-529eb4dd-144a-49ef-a032-959c9905396e tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:53:38.118078 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-529eb4dd-144a-49ef-a032-959c9905396e tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:53:38.118507 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-529eb4dd-144a-49ef-a032-959c9905396e tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:53:38.198261 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.objects.instance [None req-529eb4dd-144a-49ef-a032-959c9905396e tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lazy-loading 'services' on Instance uuid 6526331b-07d9-4ae7-8429-187bf752923d {{(pid=124203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 10:53:38.274756 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-529eb4dd-144a-49ef-a032-959c9905396e tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] 10.222.0.59 "DELETE /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d/os-volume_attachments/08a163bb-1bb2-48c5-8e6f-adc6d4f8ca05" status: 202 len: 0 microversion: 2.1 time: 0.168954 Jun 30 10:53:38.275360 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 588/1157] 10.222.0.59 () {58 vars in 1415 bytes} [Thu Jun 30 10:53:38 2022] DELETE /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d/os-volume_attachments/08a163bb-1bb2-48c5-8e6f-adc6d4f8ca05 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 10:53:38.284837 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-a005970a-58c9-4f02-bbca-097e4e83ae6f tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:53:38.285859 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-a005970a-58c9-4f02-bbca-097e4e83ae6f tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] [instance: 6526331b-07d9-4ae7-8429-187bf752923d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:53:38.294696 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a005970a-58c9-4f02-bbca-097e4e83ae6f tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:53:38.295233 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a005970a-58c9-4f02-bbca-097e4e83ae6f tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:53:38.296162 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a005970a-58c9-4f02-bbca-097e4e83ae6f tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:53:38.296656 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a005970a-58c9-4f02-bbca-097e4e83ae6f tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:53:38.328147 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-a005970a-58c9-4f02-bbca-097e4e83ae6f tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] 10.222.0.59 "GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048104 Jun 30 10:53:38.328869 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 570/1158] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 30 10:53:38 2022] GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:53:38.951370 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [req-f9671ff4-9f25-46f2-b805-b885e98dd293 req-bf8964ab-b439-4d65-9465-2e78b5a316b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6526331b-07d9-4ae7-8429-187bf752923d", "tag": "1ba7efd4-5bb9-4ada-b21b-02272e12a627"}]} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:53:38.960937 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-f9671ff4-9f25-46f2-b805-b885e98dd293 req-bf8964ab-b439-4d65-9465-2e78b5a316b8 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:53:38.961390 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-f9671ff4-9f25-46f2-b805-b885e98dd293 req-bf8964ab-b439-4d65-9465-2e78b5a316b8 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:53:38.973398 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.compute.server_external_events [req-f9671ff4-9f25-46f2-b805-b885e98dd293 req-bf8964ab-b439-4d65-9465-2e78b5a316b8 service nova] Creating event network-changed:1ba7efd4-5bb9-4ada-b21b-02272e12a627 for instance 6526331b-07d9-4ae7-8429-187bf752923d on hv-cinder-82282 Jun 30 10:53:38.978337 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [req-f9671ff4-9f25-46f2-b805-b885e98dd293 req-bf8964ab-b439-4d65-9465-2e78b5a316b8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031105 Jun 30 10:53:38.978954 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 589/1159] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:53:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:53:39.339402 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-6d45a4d2-81a4-4ea9-baaf-aafed03c1649 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:53:39.340322 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-6d45a4d2-81a4-4ea9-baaf-aafed03c1649 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] [instance: 6526331b-07d9-4ae7-8429-187bf752923d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:53:39.347354 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6d45a4d2-81a4-4ea9-baaf-aafed03c1649 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:53:39.347800 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6d45a4d2-81a4-4ea9-baaf-aafed03c1649 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:53:39.348593 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6d45a4d2-81a4-4ea9-baaf-aafed03c1649 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:53:39.349027 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6d45a4d2-81a4-4ea9-baaf-aafed03c1649 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:53:39.380341 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-6d45a4d2-81a4-4ea9-baaf-aafed03c1649 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] 10.222.0.59 "GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044930 Jun 30 10:53:39.381134 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 571/1160] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 30 10:53:39 2022] GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 30 10:53:39.392155 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-cf5cc446-dad7-4130-b552-d1a686ea6872 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:53:39.392771 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-cf5cc446-dad7-4130-b552-d1a686ea6872 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] [instance: 6526331b-07d9-4ae7-8429-187bf752923d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:53:39.398947 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-cf5cc446-dad7-4130-b552-d1a686ea6872 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:53:39.399393 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-cf5cc446-dad7-4130-b552-d1a686ea6872 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:53:39.400148 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-cf5cc446-dad7-4130-b552-d1a686ea6872 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:53:39.400612 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-cf5cc446-dad7-4130-b552-d1a686ea6872 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:53:39.476011 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.wsgi [None req-cf5cc446-dad7-4130-b552-d1a686ea6872 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] HTTP exception thrown: Instance 6526331b-07d9-4ae7-8429-187bf752923d is not attached to volume 08a163bb-1bb2-48c5-8e6f-adc6d4f8ca05 Jun 30 10:53:39.483104 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-cf5cc446-dad7-4130-b552-d1a686ea6872 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Request method failure captured: Jun 30 10:53:39.483104 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: request: DELETE /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d/os-volume_attachments/08a163bb-1bb2-48c5-8e6f-adc6d4f8ca05 HTTP/1.1 Jun 30 10:53:39.483104 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Accept: application/json Jun 30 10:53:39.483104 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Accept-Encoding: identity Jun 30 10:53:39.483104 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Connection: close Jun 30 10:53:39.483104 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Content-Length: 0 Jun 30 10:53:39.483104 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Content-Type: application/json Jun 30 10:53:39.483104 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Host: 10.222.0.59 Jun 30 10:53:39.483104 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Openstack-System-Scope: None Jun 30 10:53:39.483104 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: User-Agent: python-urllib3/1.26.9 Jun 30 10:53:39.483104 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Auth-Token: gAAAAABivX_DeZlupqoCWbnzpo41tngUMKIaqZn5cB8sUfaQlQslgy9zeymeXQURSEnL5OM9EqpFbhcr75vFf2feyQBCm61_W4wH5ga2qW7r4KR_6Eqvd-gT42dVbHtXeJpBnnB9XzwbhE39DzzdJIz4_GO2CtsMFRFc7mTbIdqPEDuQdjLH91A Jun 30 10:53:39.483104 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Domain-Id: None Jun 30 10:53:39.483104 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Domain-Name: None Jun 30 10:53:39.483104 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Identity-Status: Confirmed Jun 30 10:53:39.483104 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Is-Admin-Project: True Jun 30 10:53:39.483104 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Domain-Id: default Jun 30 10:53:39.483104 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Domain-Name: Default Jun 30 10:53:39.483104 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Id: 9d4ab649bf434f78b83122111ec19083 Jun 30 10:53:39.483104 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Name: tempest-TestMinimumBasicScenario-221988893 Jun 30 10:53:39.483104 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Role: member,reader Jun 30 10:53:39.483104 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Roles: member,reader Jun 30 10:53:39.484855 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/9d4ab649bf434f78b83122111ec19083"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_9d4ab649bf434f78b83122111ec19083"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9d4ab649bf434f78b83122111ec19083"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9d4ab649bf434f78b83122111ec19083"}]}] Jun 30 10:53:39.484855 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant: tempest-TestMinimumBasicScenario-221988893 Jun 30 10:53:39.484855 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant-Id: 9d4ab649bf434f78b83122111ec19083 Jun 30 10:53:39.484855 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant-Name: tempest-TestMinimumBasicScenario-221988893 Jun 30 10:53:39.484855 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User: tempest-TestMinimumBasicScenario-221988893-project Jun 30 10:53:39.484855 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Domain-Id: default Jun 30 10:53:39.484855 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Domain-Name: Default Jun 30 10:53:39.484855 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Id: 9a24491b2e4545e289fa4f1cff4f30d1 Jun 30 10:53:39.484855 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Name: tempest-TestMinimumBasicScenario-221988893-project Jun 30 10:53:39.484855 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: method: > Jun 30 10:53:39.484855 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: exception: Instance 6526331b-07d9-4ae7-8429-187bf752923d is not attached to volume 08a163bb-1bb2-48c5-8e6f-adc6d4f8ca05 Jun 30 10:53:39.486037 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: action_args: {'server_id': '6526331b-07d9-4ae7-8429-187bf752923d', 'id': '08a163bb-1bb2-48c5-8e6f-adc6d4f8ca05'} Jun 30 10:53:39.486037 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:53:39.486037 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:53:39.486037 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 30 10:53:39.486037 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 30 10:53:39.486037 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 30 10:53:39.486037 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 30 10:53:39.486037 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 30 10:53:39.486037 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 30 10:53:39.486037 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 08a163bb-1bb2-48c5-8e6f-adc6d4f8ca05. Jun 30 10:53:39.486037 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:53:39.486037 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:53:39.486037 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:53:39.486037 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:53:39.486037 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:53:39.486037 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:53:39.486037 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:53:39.486037 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:53:39.486037 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:53:39.487329 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:53:39.487329 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 30 10:53:39.487329 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 30 10:53:39.487329 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6526331b-07d9-4ae7-8429-187bf752923d is not attached to volume 08a163bb-1bb2-48c5-8e6f-adc6d4f8ca05 Jun 30 10:53:39.487329 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:53:39.487329 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:53:39.487329 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:53:39.487329 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:53:39.487329 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:53:39.487329 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:53:39.487329 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:53:39.487329 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:53:39.487329 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6526331b-07d9-4ae7-8429-187bf752923d is not attached to volume 08a163bb-1bb2-48c5-8e6f-adc6d4f8ca05 Jun 30 10:53:39.487329 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:53:39.487329 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-cf5cc446-dad7-4130-b552-d1a686ea6872 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Returning 404 to user: Instance 6526331b-07d9-4ae7-8429-187bf752923d is not attached to volume 08a163bb-1bb2-48c5-8e6f-adc6d4f8ca05 {{(pid=124203) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:53:39.488349 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-cf5cc446-dad7-4130-b552-d1a686ea6872 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] 10.222.0.59 "DELETE /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d/os-volume_attachments/08a163bb-1bb2-48c5-8e6f-adc6d4f8ca05" status: 404 len: 154 microversion: 2.1 time: 0.097675 Jun 30 10:53:39.488349 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 590/1161] 10.222.0.59 () {58 vars in 1415 bytes} [Thu Jun 30 10:53:39 2022] DELETE /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d/os-volume_attachments/08a163bb-1bb2-48c5-8e6f-adc6d4f8ca05 => generated 154 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 10:53:43.760262 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-4853cbdf-6b79-4b1e-95ce-ed0883e4014f tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:53:43.760773 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-4853cbdf-6b79-4b1e-95ce-ed0883e4014f tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] [instance: 6526331b-07d9-4ae7-8429-187bf752923d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:53:43.767743 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-4853cbdf-6b79-4b1e-95ce-ed0883e4014f tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:53:43.768191 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-4853cbdf-6b79-4b1e-95ce-ed0883e4014f tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:53:43.768987 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-4853cbdf-6b79-4b1e-95ce-ed0883e4014f tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:53:43.769422 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-4853cbdf-6b79-4b1e-95ce-ed0883e4014f tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:53:43.795330 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-4853cbdf-6b79-4b1e-95ce-ed0883e4014f tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] [instance: 6526331b-07d9-4ae7-8429-187bf752923d] Going to try to terminate instance {{(pid=124204) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 10:53:43.877764 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-4853cbdf-6b79-4b1e-95ce-ed0883e4014f tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] 10.222.0.59 "DELETE /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d" status: 204 len: 0 microversion: 2.1 time: 0.120883 Jun 30 10:53:43.878284 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 572/1162] 10.222.0.59 () {58 vars in 1238 bytes} [Thu Jun 30 10:53:43 2022] DELETE /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 10:53:43.886877 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-f1e79212-bd60-4896-bb25-29c9a934cb8c tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:53:43.887477 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-f1e79212-bd60-4896-bb25-29c9a934cb8c tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] [instance: 6526331b-07d9-4ae7-8429-187bf752923d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:53:43.893942 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-f1e79212-bd60-4896-bb25-29c9a934cb8c tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:53:43.894380 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-f1e79212-bd60-4896-bb25-29c9a934cb8c tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:53:43.895125 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-f1e79212-bd60-4896-bb25-29c9a934cb8c tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:53:43.895548 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-f1e79212-bd60-4896-bb25-29c9a934cb8c tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:53:44.025081 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-f1e79212-bd60-4896-bb25-29c9a934cb8c tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a24491b2e4545e289fa4f1cff4f30d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ab649bf434f78b83122111ec19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:53:44.033142 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-f1e79212-bd60-4896-bb25-29c9a934cb8c tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] 10.222.0.59 "GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d" status: 200 len: 1554 microversion: 2.1 time: 0.150298 Jun 30 10:53:44.033698 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 591/1163] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:53:43 2022] GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:53:45.051549 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-eaef95bb-4252-4437-9b81-135e6056362f tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:53:45.052249 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-eaef95bb-4252-4437-9b81-135e6056362f tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] [instance: 6526331b-07d9-4ae7-8429-187bf752923d] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:53:45.058744 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-eaef95bb-4252-4437-9b81-135e6056362f tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:53:45.059194 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-eaef95bb-4252-4437-9b81-135e6056362f tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:53:45.059953 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-eaef95bb-4252-4437-9b81-135e6056362f tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:53:45.060388 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-eaef95bb-4252-4437-9b81-135e6056362f tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:53:45.188037 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-eaef95bb-4252-4437-9b81-135e6056362f tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a24491b2e4545e289fa4f1cff4f30d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ab649bf434f78b83122111ec19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:53:45.195470 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-eaef95bb-4252-4437-9b81-135e6056362f tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] 10.222.0.59 "GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d" status: 200 len: 1554 microversion: 2.1 time: 0.148216 Jun 30 10:53:45.196039 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 573/1164] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:53:45 2022] GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d => generated 1554 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:53:46.212821 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-7e05142c-e5e1-4160-b0b5-07cd5c5d18e6 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:53:46.213427 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-7e05142c-e5e1-4160-b0b5-07cd5c5d18e6 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] [instance: 6526331b-07d9-4ae7-8429-187bf752923d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:53:46.220565 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-7e05142c-e5e1-4160-b0b5-07cd5c5d18e6 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:53:46.220978 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-7e05142c-e5e1-4160-b0b5-07cd5c5d18e6 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:53:46.221821 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-7e05142c-e5e1-4160-b0b5-07cd5c5d18e6 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:53:46.222257 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-7e05142c-e5e1-4160-b0b5-07cd5c5d18e6 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:53:46.375852 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-7e05142c-e5e1-4160-b0b5-07cd5c5d18e6 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a24491b2e4545e289fa4f1cff4f30d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ab649bf434f78b83122111ec19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:53:46.383694 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [req-4a7ed45e-7aab-4c97-94eb-a312461cccfb req-8bd13d91-48f9-4ff9-a1c5-6e0f85280662 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6526331b-07d9-4ae7-8429-187bf752923d", "name": "network-vif-deleted", "tag": "1ba7efd4-5bb9-4ada-b21b-02272e12a627"}]} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:53:46.384383 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-7e05142c-e5e1-4160-b0b5-07cd5c5d18e6 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] 10.222.0.59 "GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d" status: 200 len: 1554 microversion: 2.1 time: 0.175450 Jun 30 10:53:46.385145 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 592/1165] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:53:46 2022] GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d => generated 1554 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:53:46.396485 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-4a7ed45e-7aab-4c97-94eb-a312461cccfb req-8bd13d91-48f9-4ff9-a1c5-6e0f85280662 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:53:46.396970 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-4a7ed45e-7aab-4c97-94eb-a312461cccfb req-8bd13d91-48f9-4ff9-a1c5-6e0f85280662 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:53:46.408734 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.compute.server_external_events [req-4a7ed45e-7aab-4c97-94eb-a312461cccfb req-8bd13d91-48f9-4ff9-a1c5-6e0f85280662 service nova] Creating event network-vif-deleted:1ba7efd4-5bb9-4ada-b21b-02272e12a627 for instance 6526331b-07d9-4ae7-8429-187bf752923d on hv-cinder-82282 Jun 30 10:53:46.413462 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [req-4a7ed45e-7aab-4c97-94eb-a312461cccfb req-8bd13d91-48f9-4ff9-a1c5-6e0f85280662 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033315 Jun 30 10:53:46.414062 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 574/1166] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 10:53:47.402138 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-bea11dc0-f376-494c-a5ff-b85c2dcbd0d6 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:53:47.402760 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-bea11dc0-f376-494c-a5ff-b85c2dcbd0d6 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] [instance: 6526331b-07d9-4ae7-8429-187bf752923d] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:53:47.409825 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-bea11dc0-f376-494c-a5ff-b85c2dcbd0d6 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:53:47.410276 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-bea11dc0-f376-494c-a5ff-b85c2dcbd0d6 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:53:47.411039 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-bea11dc0-f376-494c-a5ff-b85c2dcbd0d6 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:53:47.411479 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-bea11dc0-f376-494c-a5ff-b85c2dcbd0d6 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:53:47.425294 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.wsgi [None req-bea11dc0-f376-494c-a5ff-b85c2dcbd0d6 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] HTTP exception thrown: Instance 6526331b-07d9-4ae7-8429-187bf752923d could not be found. Jun 30 10:53:47.426798 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-bea11dc0-f376-494c-a5ff-b85c2dcbd0d6 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Request method failure captured: Jun 30 10:53:47.426798 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: request: GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d HTTP/1.1 Jun 30 10:53:47.426798 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Accept: application/json Jun 30 10:53:47.426798 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Accept-Encoding: identity Jun 30 10:53:47.426798 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Connection: close Jun 30 10:53:47.426798 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Content-Length: 0 Jun 30 10:53:47.426798 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Content-Type: application/json Jun 30 10:53:47.426798 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Host: 10.222.0.59 Jun 30 10:53:47.426798 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Openstack-System-Scope: None Jun 30 10:53:47.426798 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: User-Agent: python-urllib3/1.26.9 Jun 30 10:53:47.426798 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Auth-Token: gAAAAABivX_DeZlupqoCWbnzpo41tngUMKIaqZn5cB8sUfaQlQslgy9zeymeXQURSEnL5OM9EqpFbhcr75vFf2feyQBCm61_W4wH5ga2qW7r4KR_6Eqvd-gT42dVbHtXeJpBnnB9XzwbhE39DzzdJIz4_GO2CtsMFRFc7mTbIdqPEDuQdjLH91A Jun 30 10:53:47.426798 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Domain-Id: None Jun 30 10:53:47.426798 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Domain-Name: None Jun 30 10:53:47.426798 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Identity-Status: Confirmed Jun 30 10:53:47.426798 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Is-Admin-Project: True Jun 30 10:53:47.426798 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Domain-Id: default Jun 30 10:53:47.426798 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Domain-Name: Default Jun 30 10:53:47.426798 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Id: 9d4ab649bf434f78b83122111ec19083 Jun 30 10:53:47.426798 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Name: tempest-TestMinimumBasicScenario-221988893 Jun 30 10:53:47.426798 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Role: member,reader Jun 30 10:53:47.426798 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Roles: member,reader Jun 30 10:53:47.428381 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/9d4ab649bf434f78b83122111ec19083"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_9d4ab649bf434f78b83122111ec19083"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9d4ab649bf434f78b83122111ec19083"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9d4ab649bf434f78b83122111ec19083"}]}] Jun 30 10:53:47.428381 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant: tempest-TestMinimumBasicScenario-221988893 Jun 30 10:53:47.428381 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant-Id: 9d4ab649bf434f78b83122111ec19083 Jun 30 10:53:47.428381 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant-Name: tempest-TestMinimumBasicScenario-221988893 Jun 30 10:53:47.428381 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User: tempest-TestMinimumBasicScenario-221988893-project Jun 30 10:53:47.428381 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Domain-Id: default Jun 30 10:53:47.428381 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Domain-Name: Default Jun 30 10:53:47.428381 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Id: 9a24491b2e4545e289fa4f1cff4f30d1 Jun 30 10:53:47.428381 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Name: tempest-TestMinimumBasicScenario-221988893-project Jun 30 10:53:47.428381 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: method: > Jun 30 10:53:47.428381 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: exception: Instance 6526331b-07d9-4ae7-8429-187bf752923d could not be found. Jun 30 10:53:47.428381 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: action_args: {'id': '6526331b-07d9-4ae7-8429-187bf752923d'} Jun 30 10:53:47.429398 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:53:47.429398 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:53:47.429398 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 10:53:47.429398 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 10:53:47.429398 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 10:53:47.429398 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 10:53:47.429398 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 10:53:47.429398 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 10:53:47.429398 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 10:53:47.429398 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 10:53:47.429398 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6526331b-07d9-4ae7-8429-187bf752923d could not be found. Jun 30 10:53:47.429398 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:53:47.429398 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:53:47.429398 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:53:47.429398 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:53:47.429398 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:53:47.429398 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:53:47.429398 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:53:47.429398 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:53:47.429398 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:53:47.430948 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:53:47.430948 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 10:53:47.430948 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 10:53:47.430948 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 10:53:47.430948 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 10:53:47.430948 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 10:53:47.430948 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:53:47.430948 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6526331b-07d9-4ae7-8429-187bf752923d could not be found. Jun 30 10:53:47.430948 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:53:47.430948 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:53:47.430948 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:53:47.430948 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:53:47.430948 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:53:47.430948 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:53:47.430948 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:53:47.430948 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:53:47.430948 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6526331b-07d9-4ae7-8429-187bf752923d could not be found. Jun 30 10:53:47.430948 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:53:47.432489 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-bea11dc0-f376-494c-a5ff-b85c2dcbd0d6 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Returning 404 to user: Instance 6526331b-07d9-4ae7-8429-187bf752923d could not be found. {{(pid=124203) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:53:47.432489 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-bea11dc0-f376-494c-a5ff-b85c2dcbd0d6 tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] 10.222.0.59 "GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d" status: 404 len: 111 microversion: 2.1 time: 0.030009 Jun 30 10:53:47.432489 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 593/1167] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:53:47 2022] GET /compute/v2.1/servers/6526331b-07d9-4ae7-8429-187bf752923d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 10:53:47.438219 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-8195fddc-02ce-4637-904a-2d09e1ab42bf tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] Calling method '.version_select at 0x7f4dadd9e3a0>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:53:47.456148 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-8195fddc-02ce-4637-904a-2d09e1ab42bf tempest-TestMinimumBasicScenario-221988893 tempest-TestMinimumBasicScenario-221988893-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-449752249" status: 202 len: 0 microversion: 2.1 time: 0.022796 Jun 30 10:53:47.456764 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 575/1168] 10.222.0.59 () {58 vars in 1268 bytes} [Thu Jun 30 10:53:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-449752249 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 10:53:56.202527 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-520c986a-9933-4cb8-922e-f5ee7fb3d4d4 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-353738400", "imageRef": "c473bd04-5a45-4eb7-b6f4-2b5033d4fc1d", "flavorRef": "452"}} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:53:56.254840 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.network.neutron [None req-520c986a-9933-4cb8-922e-f5ee7fb3d4d4 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] validate_networks() for None {{(pid=124203) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 10:53:56.523795 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.virt.hardware [None req-520c986a-9933-4cb8-922e-f5ee7fb3d4d4 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Flavor limits 0:0:0 {{(pid=124203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 10:53:56.524210 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.virt.hardware [None req-520c986a-9933-4cb8-922e-f5ee7fb3d4d4 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Image limits 0:0:0 {{(pid=124203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 10:53:56.524712 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.virt.hardware [None req-520c986a-9933-4cb8-922e-f5ee7fb3d4d4 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Flavor pref 0:0:0 {{(pid=124203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 10:53:56.525140 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.virt.hardware [None req-520c986a-9933-4cb8-922e-f5ee7fb3d4d4 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Image pref 0:0:0 {{(pid=124203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 10:53:56.525545 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.virt.hardware [None req-520c986a-9933-4cb8-922e-f5ee7fb3d4d4 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 10:53:56.534227 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-520c986a-9933-4cb8-922e-f5ee7fb3d4d4 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:53:56.534665 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-520c986a-9933-4cb8-922e-f5ee7fb3d4d4 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:53:56.535443 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-520c986a-9933-4cb8-922e-f5ee7fb3d4d4 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:53:56.535865 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-520c986a-9933-4cb8-922e-f5ee7fb3d4d4 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:53:56.552405 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.quota [None req-520c986a-9933-4cb8-922e-f5ee7fb3d4d4 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Getting quotas for project 3942296630944f26ac4de923a8430165. Resources: {'instances', 'cores', 'ram'} {{(pid=124203) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 10:53:56.556242 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.quota [None req-520c986a-9933-4cb8-922e-f5ee7fb3d4d4 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Getting quotas for user 7a01a462cd6f4007845a8a8f40090ad6 and project 3942296630944f26ac4de923a8430165. Resources: {'instances', 'cores', 'ram'} {{(pid=124203) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 10:53:56.567414 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-520c986a-9933-4cb8-922e-f5ee7fb3d4d4 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Going to run 1 instances... {{(pid=124203) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 10:53:56.569623 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-520c986a-9933-4cb8-922e-f5ee7fb3d4d4 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] [instance: 54c6a5d8-72aa-40c3-a7fc-ddf71f7f1281] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c473bd04-5a45-4eb7-b6f4-2b5033d4fc1d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124203) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 10:53:56.614153 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-520c986a-9933-4cb8-922e-f5ee7fb3d4d4 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.415406 Jun 30 10:53:56.614794 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 594/1169] 10.222.0.59 () {60 vars in 1146 bytes} [Thu Jun 30 10:53:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 417 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 10:53:56.623042 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:53:56.627059 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-f9f14f7d-fb4d-4ad1-9054-a04f53155af3 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:53:56.627888 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-f9f14f7d-fb4d-4ad1-9054-a04f53155af3 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] [instance: 54c6a5d8-72aa-40c3-a7fc-ddf71f7f1281] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:53:56.690024 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-f9f14f7d-fb4d-4ad1-9054-a04f53155af3 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a01a462cd6f4007845a8a8f40090ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3942296630944f26ac4de923a8430165', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:53:56.696890 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-f9f14f7d-fb4d-4ad1-9054-a04f53155af3 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] 10.222.0.59 "GET /compute/v2.1/servers/54c6a5d8-72aa-40c3-a7fc-ddf71f7f1281" status: 200 len: 1214 microversion: 2.1 time: 0.075756 Jun 30 10:53:56.697464 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 576/1170] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:53:56 2022] GET /compute/v2.1/servers/54c6a5d8-72aa-40c3-a7fc-ddf71f7f1281 => generated 1214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:53:57.712975 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-e11dae35-286a-4867-811f-dc8bb2e376a7 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:53:57.713579 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-e11dae35-286a-4867-811f-dc8bb2e376a7 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] [instance: 54c6a5d8-72aa-40c3-a7fc-ddf71f7f1281] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:53:57.720673 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e11dae35-286a-4867-811f-dc8bb2e376a7 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:53:57.721120 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e11dae35-286a-4867-811f-dc8bb2e376a7 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:53:57.721873 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e11dae35-286a-4867-811f-dc8bb2e376a7 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:53:57.722306 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e11dae35-286a-4867-811f-dc8bb2e376a7 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:53:57.782570 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-e11dae35-286a-4867-811f-dc8bb2e376a7 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a01a462cd6f4007845a8a8f40090ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3942296630944f26ac4de923a8430165', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:53:57.789981 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-e11dae35-286a-4867-811f-dc8bb2e376a7 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] 10.222.0.59 "GET /compute/v2.1/servers/54c6a5d8-72aa-40c3-a7fc-ddf71f7f1281" status: 200 len: 1272 microversion: 2.1 time: 0.080943 Jun 30 10:53:57.790553 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 595/1171] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:53:57 2022] GET /compute/v2.1/servers/54c6a5d8-72aa-40c3-a7fc-ddf71f7f1281 => generated 1272 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:53:58.807100 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-deed680a-6c64-494d-85a0-531f7810ea53 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:53:58.807708 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-deed680a-6c64-494d-85a0-531f7810ea53 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] [instance: 54c6a5d8-72aa-40c3-a7fc-ddf71f7f1281] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:53:58.814751 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-deed680a-6c64-494d-85a0-531f7810ea53 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:53:58.815200 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-deed680a-6c64-494d-85a0-531f7810ea53 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:53:58.815967 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-deed680a-6c64-494d-85a0-531f7810ea53 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:53:58.816398 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-deed680a-6c64-494d-85a0-531f7810ea53 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:53:58.947533 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-deed680a-6c64-494d-85a0-531f7810ea53 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a01a462cd6f4007845a8a8f40090ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3942296630944f26ac4de923a8430165', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:53:58.955576 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-deed680a-6c64-494d-85a0-531f7810ea53 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] 10.222.0.59 "GET /compute/v2.1/servers/54c6a5d8-72aa-40c3-a7fc-ddf71f7f1281" status: 200 len: 1314 microversion: 2.1 time: 0.152314 Jun 30 10:53:58.965370 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 577/1172] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:53:58 2022] GET /compute/v2.1/servers/54c6a5d8-72aa-40c3-a7fc-ddf71f7f1281 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:53:59.225746 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [req-890fe0e8-dba0-44d8-b046-668876c1e543 req-7aa609d8-73a0-40e5-9fdc-bc6a050c7f0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54c6a5d8-72aa-40c3-a7fc-ddf71f7f1281", "tag": "4a822b8e-94ec-4245-954b-175e00f0e026"}]} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:53:59.236722 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-890fe0e8-dba0-44d8-b046-668876c1e543 req-7aa609d8-73a0-40e5-9fdc-bc6a050c7f0f service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:53:59.242555 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-890fe0e8-dba0-44d8-b046-668876c1e543 req-7aa609d8-73a0-40e5-9fdc-bc6a050c7f0f service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:53:59.256099 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.compute.server_external_events [req-890fe0e8-dba0-44d8-b046-668876c1e543 req-7aa609d8-73a0-40e5-9fdc-bc6a050c7f0f service nova] Creating event network-changed:4a822b8e-94ec-4245-954b-175e00f0e026 for instance 54c6a5d8-72aa-40c3-a7fc-ddf71f7f1281 on hv-cinder-82282 Jun 30 10:53:59.261485 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [req-890fe0e8-dba0-44d8-b046-668876c1e543 req-7aa609d8-73a0-40e5-9fdc-bc6a050c7f0f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040391 Jun 30 10:53:59.262429 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 596/1173] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:53:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:53:59.972533 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-4061822d-77f0-498e-a6fa-d8fe418ec58c tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:53:59.973151 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-4061822d-77f0-498e-a6fa-d8fe418ec58c tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] [instance: 54c6a5d8-72aa-40c3-a7fc-ddf71f7f1281] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:53:59.979682 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-4061822d-77f0-498e-a6fa-d8fe418ec58c tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:53:59.980130 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-4061822d-77f0-498e-a6fa-d8fe418ec58c tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:53:59.980924 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-4061822d-77f0-498e-a6fa-d8fe418ec58c tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:53:59.981957 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-4061822d-77f0-498e-a6fa-d8fe418ec58c tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:54:00.111765 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-4061822d-77f0-498e-a6fa-d8fe418ec58c tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a01a462cd6f4007845a8a8f40090ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3942296630944f26ac4de923a8430165', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:54:00.119157 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-4061822d-77f0-498e-a6fa-d8fe418ec58c tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] 10.222.0.59 "GET /compute/v2.1/servers/54c6a5d8-72aa-40c3-a7fc-ddf71f7f1281" status: 200 len: 1314 microversion: 2.1 time: 0.150527 Jun 30 10:54:00.119721 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 578/1174] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:53:59 2022] GET /compute/v2.1/servers/54c6a5d8-72aa-40c3-a7fc-ddf71f7f1281 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:54:01.136735 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-83f629f8-6d39-4980-af60-c339a71cbd51 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:54:01.137440 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-83f629f8-6d39-4980-af60-c339a71cbd51 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] [instance: 54c6a5d8-72aa-40c3-a7fc-ddf71f7f1281] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:54:01.143666 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-83f629f8-6d39-4980-af60-c339a71cbd51 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:54:01.144119 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-83f629f8-6d39-4980-af60-c339a71cbd51 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:54:01.144908 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-83f629f8-6d39-4980-af60-c339a71cbd51 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:54:01.145352 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-83f629f8-6d39-4980-af60-c339a71cbd51 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:54:01.271294 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-83f629f8-6d39-4980-af60-c339a71cbd51 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a01a462cd6f4007845a8a8f40090ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3942296630944f26ac4de923a8430165', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:54:01.278812 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-83f629f8-6d39-4980-af60-c339a71cbd51 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] 10.222.0.59 "GET /compute/v2.1/servers/54c6a5d8-72aa-40c3-a7fc-ddf71f7f1281" status: 200 len: 1314 microversion: 2.1 time: 0.146742 Jun 30 10:54:01.279376 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 597/1175] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:54:01 2022] GET /compute/v2.1/servers/54c6a5d8-72aa-40c3-a7fc-ddf71f7f1281 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:54:02.295164 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-2ced0c61-ac3f-44da-9b2c-bd15285623c5 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:54:02.295773 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-2ced0c61-ac3f-44da-9b2c-bd15285623c5 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] [instance: 54c6a5d8-72aa-40c3-a7fc-ddf71f7f1281] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:54:02.302484 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-2ced0c61-ac3f-44da-9b2c-bd15285623c5 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:54:02.302943 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-2ced0c61-ac3f-44da-9b2c-bd15285623c5 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:54:02.303720 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-2ced0c61-ac3f-44da-9b2c-bd15285623c5 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:54:02.304160 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-2ced0c61-ac3f-44da-9b2c-bd15285623c5 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:54:02.434770 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-2ced0c61-ac3f-44da-9b2c-bd15285623c5 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a01a462cd6f4007845a8a8f40090ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3942296630944f26ac4de923a8430165', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:54:02.442761 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-2ced0c61-ac3f-44da-9b2c-bd15285623c5 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] 10.222.0.59 "GET /compute/v2.1/servers/54c6a5d8-72aa-40c3-a7fc-ddf71f7f1281" status: 200 len: 1314 microversion: 2.1 time: 0.151430 Jun 30 10:54:02.443336 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 579/1176] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:54:02 2022] GET /compute/v2.1/servers/54c6a5d8-72aa-40c3-a7fc-ddf71f7f1281 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:54:03.459980 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-1e961770-4ba5-46f0-b7a8-4c35687938f5 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:54:03.460624 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-1e961770-4ba5-46f0-b7a8-4c35687938f5 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] [instance: 54c6a5d8-72aa-40c3-a7fc-ddf71f7f1281] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:54:03.467079 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-1e961770-4ba5-46f0-b7a8-4c35687938f5 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:54:03.467527 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-1e961770-4ba5-46f0-b7a8-4c35687938f5 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:54:03.468289 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-1e961770-4ba5-46f0-b7a8-4c35687938f5 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:54:03.468762 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-1e961770-4ba5-46f0-b7a8-4c35687938f5 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:54:03.599626 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-1e961770-4ba5-46f0-b7a8-4c35687938f5 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a01a462cd6f4007845a8a8f40090ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3942296630944f26ac4de923a8430165', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:54:03.607538 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-1e961770-4ba5-46f0-b7a8-4c35687938f5 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] 10.222.0.59 "GET /compute/v2.1/servers/54c6a5d8-72aa-40c3-a7fc-ddf71f7f1281" status: 200 len: 1314 microversion: 2.1 time: 0.150948 Jun 30 10:54:03.608095 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 598/1177] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:54:03 2022] GET /compute/v2.1/servers/54c6a5d8-72aa-40c3-a7fc-ddf71f7f1281 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:54:04.186337 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [req-cf00e085-ef2d-4d11-8367-ee5654cdbdbc req-73d090da-5b02-4a3a-8d95-3ca2652f7895 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54c6a5d8-72aa-40c3-a7fc-ddf71f7f1281", "name": "network-vif-plugged", "status": "completed", "tag": "4a822b8e-94ec-4245-954b-175e00f0e026"}]} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:54:04.195140 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-cf00e085-ef2d-4d11-8367-ee5654cdbdbc req-73d090da-5b02-4a3a-8d95-3ca2652f7895 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:54:04.195580 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-cf00e085-ef2d-4d11-8367-ee5654cdbdbc req-73d090da-5b02-4a3a-8d95-3ca2652f7895 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:54:04.207096 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.compute.server_external_events [req-cf00e085-ef2d-4d11-8367-ee5654cdbdbc req-73d090da-5b02-4a3a-8d95-3ca2652f7895 service nova] Creating event network-vif-plugged:4a822b8e-94ec-4245-954b-175e00f0e026 for instance 54c6a5d8-72aa-40c3-a7fc-ddf71f7f1281 on hv-cinder-82282 Jun 30 10:54:04.212135 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [req-cf00e085-ef2d-4d11-8367-ee5654cdbdbc req-73d090da-5b02-4a3a-8d95-3ca2652f7895 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030071 Jun 30 10:54:04.212945 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 580/1178] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:54:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:54:04.624990 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-b86bbe0f-3d63-47a1-80df-01f12455270d tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:54:04.625614 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-b86bbe0f-3d63-47a1-80df-01f12455270d tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] [instance: 54c6a5d8-72aa-40c3-a7fc-ddf71f7f1281] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:54:04.632104 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b86bbe0f-3d63-47a1-80df-01f12455270d tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:54:04.632601 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b86bbe0f-3d63-47a1-80df-01f12455270d tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:54:04.633361 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b86bbe0f-3d63-47a1-80df-01f12455270d tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:54:04.633808 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b86bbe0f-3d63-47a1-80df-01f12455270d tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:54:04.758772 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-b86bbe0f-3d63-47a1-80df-01f12455270d tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a01a462cd6f4007845a8a8f40090ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3942296630944f26ac4de923a8430165', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:54:04.766654 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-b86bbe0f-3d63-47a1-80df-01f12455270d tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] 10.222.0.59 "GET /compute/v2.1/servers/54c6a5d8-72aa-40c3-a7fc-ddf71f7f1281" status: 200 len: 1314 microversion: 2.1 time: 0.145799 Jun 30 10:54:04.767216 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 599/1179] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:54:04 2022] GET /compute/v2.1/servers/54c6a5d8-72aa-40c3-a7fc-ddf71f7f1281 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:54:05.784402 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-1f913de6-cc81-41cc-8e86-54a799e1b8a7 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:54:05.785089 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-1f913de6-cc81-41cc-8e86-54a799e1b8a7 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] [instance: 54c6a5d8-72aa-40c3-a7fc-ddf71f7f1281] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:54:05.791757 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1f913de6-cc81-41cc-8e86-54a799e1b8a7 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:54:05.792374 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1f913de6-cc81-41cc-8e86-54a799e1b8a7 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:54:05.793172 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1f913de6-cc81-41cc-8e86-54a799e1b8a7 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:54:05.793613 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1f913de6-cc81-41cc-8e86-54a799e1b8a7 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:54:06.134614 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-1f913de6-cc81-41cc-8e86-54a799e1b8a7 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a01a462cd6f4007845a8a8f40090ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3942296630944f26ac4de923a8430165', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:54:06.142643 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-1f913de6-cc81-41cc-8e86-54a799e1b8a7 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] 10.222.0.59 "GET /compute/v2.1/servers/54c6a5d8-72aa-40c3-a7fc-ddf71f7f1281" status: 200 len: 1314 microversion: 2.1 time: 0.362527 Jun 30 10:54:06.143206 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 581/1180] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:54:05 2022] GET /compute/v2.1/servers/54c6a5d8-72aa-40c3-a7fc-ddf71f7f1281 => generated 1314 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:54:07.159815 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-b1799b24-d6cd-4176-b6cd-8a579f69b885 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:54:07.160418 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-b1799b24-d6cd-4176-b6cd-8a579f69b885 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] [instance: 54c6a5d8-72aa-40c3-a7fc-ddf71f7f1281] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:54:07.162794 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_cell0:SELECT=2 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:54:07.163451 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_cell0:SELECT=6 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:54:07.164115 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:54:07.170844 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b1799b24-d6cd-4176-b6cd-8a579f69b885 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:54:07.171280 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b1799b24-d6cd-4176-b6cd-8a579f69b885 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:54:07.172052 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b1799b24-d6cd-4176-b6cd-8a579f69b885 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:54:07.172460 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b1799b24-d6cd-4176-b6cd-8a579f69b885 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:54:07.177178 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_cell1:SELECT=64,nova_cell1:INSERT=1 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:54:07.300058 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-b1799b24-d6cd-4176-b6cd-8a579f69b885 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a01a462cd6f4007845a8a8f40090ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3942296630944f26ac4de923a8430165', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:54:07.307452 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-b1799b24-d6cd-4176-b6cd-8a579f69b885 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] 10.222.0.59 "GET /compute/v2.1/servers/54c6a5d8-72aa-40c3-a7fc-ddf71f7f1281" status: 200 len: 1464 microversion: 2.1 time: 0.151457 Jun 30 10:54:07.308048 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 600/1181] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:54:07 2022] GET /compute/v2.1/servers/54c6a5d8-72aa-40c3-a7fc-ddf71f7f1281 => generated 1464 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:54:07.346500 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-3681e6ee-eaf8-41d0-a6a3-fba824eb452b tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:54:07.346964 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-3681e6ee-eaf8-41d0-a6a3-fba824eb452b tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] [instance: 54c6a5d8-72aa-40c3-a7fc-ddf71f7f1281] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:54:07.348871 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_cell0:SELECT=2 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:54:07.354545 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-3681e6ee-eaf8-41d0-a6a3-fba824eb452b tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:54:07.354996 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-3681e6ee-eaf8-41d0-a6a3-fba824eb452b tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:54:07.355758 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-3681e6ee-eaf8-41d0-a6a3-fba824eb452b tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:54:07.356196 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-3681e6ee-eaf8-41d0-a6a3-fba824eb452b tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:54:07.381249 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-3681e6ee-eaf8-41d0-a6a3-fba824eb452b tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] [instance: 54c6a5d8-72aa-40c3-a7fc-ddf71f7f1281] Going to try to terminate instance {{(pid=124204) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 10:54:07.462772 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-3681e6ee-eaf8-41d0-a6a3-fba824eb452b tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] 10.222.0.59 "DELETE /compute/v2.1/servers/54c6a5d8-72aa-40c3-a7fc-ddf71f7f1281" status: 204 len: 0 microversion: 2.1 time: 0.119874 Jun 30 10:54:07.463390 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 582/1182] 10.222.0.59 () {58 vars in 1238 bytes} [Thu Jun 30 10:54:07 2022] DELETE /compute/v2.1/servers/54c6a5d8-72aa-40c3-a7fc-ddf71f7f1281 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 10:54:07.474166 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-1ccb1d19-a6e2-4433-a278-b707b03baabf tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:54:07.475245 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-1ccb1d19-a6e2-4433-a278-b707b03baabf tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] [instance: 54c6a5d8-72aa-40c3-a7fc-ddf71f7f1281] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:54:07.481567 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-1ccb1d19-a6e2-4433-a278-b707b03baabf tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:54:07.482048 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-1ccb1d19-a6e2-4433-a278-b707b03baabf tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:54:07.482839 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-1ccb1d19-a6e2-4433-a278-b707b03baabf tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:54:07.483278 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-1ccb1d19-a6e2-4433-a278-b707b03baabf tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:54:07.612538 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-1ccb1d19-a6e2-4433-a278-b707b03baabf tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a01a462cd6f4007845a8a8f40090ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3942296630944f26ac4de923a8430165', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:54:07.620048 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-1ccb1d19-a6e2-4433-a278-b707b03baabf tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] 10.222.0.59 "GET /compute/v2.1/servers/54c6a5d8-72aa-40c3-a7fc-ddf71f7f1281" status: 200 len: 1470 microversion: 2.1 time: 0.152355 Jun 30 10:54:07.620851 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 601/1183] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:54:07 2022] GET /compute/v2.1/servers/54c6a5d8-72aa-40c3-a7fc-ddf71f7f1281 => generated 1470 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:54:08.639393 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-e9831fef-aca4-4672-ada4-35c8d1cc4346 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:54:08.640083 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-e9831fef-aca4-4672-ada4-35c8d1cc4346 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] [instance: 54c6a5d8-72aa-40c3-a7fc-ddf71f7f1281] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:54:08.642541 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:54:08.647785 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-e9831fef-aca4-4672-ada4-35c8d1cc4346 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:54:08.648225 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-e9831fef-aca4-4672-ada4-35c8d1cc4346 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:54:08.649007 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-e9831fef-aca4-4672-ada4-35c8d1cc4346 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:54:08.649430 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-e9831fef-aca4-4672-ada4-35c8d1cc4346 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:54:08.782860 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-e9831fef-aca4-4672-ada4-35c8d1cc4346 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a01a462cd6f4007845a8a8f40090ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3942296630944f26ac4de923a8430165', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:54:08.790347 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-e9831fef-aca4-4672-ada4-35c8d1cc4346 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] 10.222.0.59 "GET /compute/v2.1/servers/54c6a5d8-72aa-40c3-a7fc-ddf71f7f1281" status: 200 len: 1470 microversion: 2.1 time: 0.155752 Jun 30 10:54:08.790916 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 583/1184] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:54:08 2022] GET /compute/v2.1/servers/54c6a5d8-72aa-40c3-a7fc-ddf71f7f1281 => generated 1470 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:54:09.337882 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [req-f2ef8a9f-f4ce-45db-8325-f1a66c97331c req-7a765662-5922-4f29-82db-d0efd4de6769 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54c6a5d8-72aa-40c3-a7fc-ddf71f7f1281", "name": "network-vif-deleted", "tag": "4a822b8e-94ec-4245-954b-175e00f0e026"}]} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:54:09.348762 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-f2ef8a9f-f4ce-45db-8325-f1a66c97331c req-7a765662-5922-4f29-82db-d0efd4de6769 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:54:09.349209 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-f2ef8a9f-f4ce-45db-8325-f1a66c97331c req-7a765662-5922-4f29-82db-d0efd4de6769 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:54:09.362283 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.compute.server_external_events [req-f2ef8a9f-f4ce-45db-8325-f1a66c97331c req-7a765662-5922-4f29-82db-d0efd4de6769 service nova] Creating event network-vif-deleted:4a822b8e-94ec-4245-954b-175e00f0e026 for instance 54c6a5d8-72aa-40c3-a7fc-ddf71f7f1281 on hv-cinder-82282 Jun 30 10:54:09.368891 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [req-f2ef8a9f-f4ce-45db-8325-f1a66c97331c req-7a765662-5922-4f29-82db-d0efd4de6769 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034960 Jun 30 10:54:09.369804 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 602/1185] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:54:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:54:09.807087 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-a69bdc5c-5542-4935-bc9f-f4c0232a01c7 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:54:09.807660 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-a69bdc5c-5542-4935-bc9f-f4c0232a01c7 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] [instance: 54c6a5d8-72aa-40c3-a7fc-ddf71f7f1281] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:54:09.814154 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a69bdc5c-5542-4935-bc9f-f4c0232a01c7 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:54:09.814600 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a69bdc5c-5542-4935-bc9f-f4c0232a01c7 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:54:09.815364 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a69bdc5c-5542-4935-bc9f-f4c0232a01c7 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:54:09.815799 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a69bdc5c-5542-4935-bc9f-f4c0232a01c7 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:54:09.845728 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a69bdc5c-5542-4935-bc9f-f4c0232a01c7 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:54:09.846161 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a69bdc5c-5542-4935-bc9f-f4c0232a01c7 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:54:09.846602 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.objects.instance [None req-a69bdc5c-5542-4935-bc9f-f4c0232a01c7 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Lazy-loading 'fault' on Instance uuid 54c6a5d8-72aa-40c3-a7fc-ddf71f7f1281 {{(pid=124204) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 10:54:09.887235 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-a69bdc5c-5542-4935-bc9f-f4c0232a01c7 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a01a462cd6f4007845a8a8f40090ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3942296630944f26ac4de923a8430165', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:54:09.894869 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-a69bdc5c-5542-4935-bc9f-f4c0232a01c7 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] 10.222.0.59 "GET /compute/v2.1/servers/54c6a5d8-72aa-40c3-a7fc-ddf71f7f1281" status: 200 len: 1304 microversion: 2.1 time: 0.091673 Jun 30 10:54:09.895433 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 584/1186] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:54:09 2022] GET /compute/v2.1/servers/54c6a5d8-72aa-40c3-a7fc-ddf71f7f1281 => generated 1304 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:54:10.913641 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-fc01b253-098f-43fd-b66d-6646da771797 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:54:10.914326 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-fc01b253-098f-43fd-b66d-6646da771797 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] [instance: 54c6a5d8-72aa-40c3-a7fc-ddf71f7f1281] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:54:10.920697 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-fc01b253-098f-43fd-b66d-6646da771797 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:54:10.921136 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-fc01b253-098f-43fd-b66d-6646da771797 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:54:10.921884 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-fc01b253-098f-43fd-b66d-6646da771797 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:54:10.922314 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-fc01b253-098f-43fd-b66d-6646da771797 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:54:10.935170 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.wsgi [None req-fc01b253-098f-43fd-b66d-6646da771797 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] HTTP exception thrown: Instance 54c6a5d8-72aa-40c3-a7fc-ddf71f7f1281 could not be found. Jun 30 10:54:10.936781 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-fc01b253-098f-43fd-b66d-6646da771797 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Request method failure captured: Jun 30 10:54:10.936781 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: request: GET /compute/v2.1/servers/54c6a5d8-72aa-40c3-a7fc-ddf71f7f1281 HTTP/1.1 Jun 30 10:54:10.936781 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Accept: application/json Jun 30 10:54:10.936781 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Accept-Encoding: identity Jun 30 10:54:10.936781 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Connection: close Jun 30 10:54:10.936781 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Content-Length: 0 Jun 30 10:54:10.936781 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Content-Type: application/json Jun 30 10:54:10.936781 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Host: 10.222.0.59 Jun 30 10:54:10.936781 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Openstack-System-Scope: None Jun 30 10:54:10.936781 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: User-Agent: python-urllib3/1.26.9 Jun 30 10:54:10.936781 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Auth-Token: gAAAAABivYDC-ojtZ6vtBJEcN4fkX7SAP6oTnks4YI7bKgxOj8H6qy4qiFwggd-o7iQ5AOIcImQp8ByqqIXIRpK8Ap3dT1LwV-546oHbqdgYh-V5Ko-RVJ3bccdXiw2iC0WMQKBRBx3geGsxnZ4s8zaIiPFGQqRiyUS72i7Hw3-HJe5WdKYJmug Jun 30 10:54:10.936781 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Domain-Id: None Jun 30 10:54:10.936781 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Domain-Name: None Jun 30 10:54:10.936781 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Identity-Status: Confirmed Jun 30 10:54:10.936781 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Is-Admin-Project: True Jun 30 10:54:10.936781 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Domain-Id: default Jun 30 10:54:10.936781 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Domain-Name: Default Jun 30 10:54:10.936781 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Id: 3942296630944f26ac4de923a8430165 Jun 30 10:54:10.936781 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Name: tempest-VolumesNegativeTest-1267274145 Jun 30 10:54:10.936781 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Role: member,reader Jun 30 10:54:10.936781 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Roles: member,reader Jun 30 10:54:10.938493 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/3942296630944f26ac4de923a8430165"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_3942296630944f26ac4de923a8430165"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/3942296630944f26ac4de923a8430165"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/3942296630944f26ac4de923a8430165"}]}] Jun 30 10:54:10.938493 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant: tempest-VolumesNegativeTest-1267274145 Jun 30 10:54:10.938493 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant-Id: 3942296630944f26ac4de923a8430165 Jun 30 10:54:10.938493 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant-Name: tempest-VolumesNegativeTest-1267274145 Jun 30 10:54:10.938493 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User: tempest-VolumesNegativeTest-1267274145-project Jun 30 10:54:10.938493 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Domain-Id: default Jun 30 10:54:10.938493 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Domain-Name: Default Jun 30 10:54:10.938493 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Id: 7a01a462cd6f4007845a8a8f40090ad6 Jun 30 10:54:10.938493 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Name: tempest-VolumesNegativeTest-1267274145-project Jun 30 10:54:10.938493 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: method: > Jun 30 10:54:10.938493 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: exception: Instance 54c6a5d8-72aa-40c3-a7fc-ddf71f7f1281 could not be found. Jun 30 10:54:10.938493 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: action_args: {'id': '54c6a5d8-72aa-40c3-a7fc-ddf71f7f1281'} Jun 30 10:54:10.939517 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:54:10.939517 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:54:10.939517 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 10:54:10.939517 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 10:54:10.939517 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 10:54:10.939517 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 10:54:10.939517 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 10:54:10.939517 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 10:54:10.939517 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 10:54:10.939517 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 10:54:10.939517 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54c6a5d8-72aa-40c3-a7fc-ddf71f7f1281 could not be found. Jun 30 10:54:10.939517 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:54:10.939517 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:54:10.939517 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:54:10.939517 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:54:10.939517 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:54:10.939517 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:54:10.939517 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:54:10.939517 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:54:10.939517 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:54:10.941382 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:54:10.941382 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 10:54:10.941382 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 10:54:10.941382 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 10:54:10.941382 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 10:54:10.941382 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 10:54:10.941382 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:54:10.941382 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54c6a5d8-72aa-40c3-a7fc-ddf71f7f1281 could not be found. Jun 30 10:54:10.941382 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:54:10.941382 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:54:10.941382 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:54:10.941382 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:54:10.941382 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:54:10.941382 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:54:10.941382 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:54:10.941382 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:54:10.941382 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54c6a5d8-72aa-40c3-a7fc-ddf71f7f1281 could not be found. Jun 30 10:54:10.941382 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 10:54:10.942972 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-fc01b253-098f-43fd-b66d-6646da771797 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] Returning 404 to user: Instance 54c6a5d8-72aa-40c3-a7fc-ddf71f7f1281 could not be found. {{(pid=124203) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:54:10.942972 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-fc01b253-098f-43fd-b66d-6646da771797 tempest-VolumesNegativeTest-1267274145 tempest-VolumesNegativeTest-1267274145-project] 10.222.0.59 "GET /compute/v2.1/servers/54c6a5d8-72aa-40c3-a7fc-ddf71f7f1281" status: 404 len: 111 microversion: 2.1 time: 0.028762 Jun 30 10:54:10.942972 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 603/1187] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:54:10 2022] GET /compute/v2.1/servers/54c6a5d8-72aa-40c3-a7fc-ddf71f7f1281 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 10:55:12.839793 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 10:55:12.840421 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Thu Jun 30 10:55:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 10:55:14.534375 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 10:55:14.534866 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Thu Jun 30 10:55:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 10:55:38.994891 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f6b7188a-ec1e-4806-a603-a608d9b02a0b] AMQP server on 10.222.0.59:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 30 10:55:38.995743 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_api:SELECT=5 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:55:38.996710 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:55:39.001379 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-3b71f30f-fec5-4d78-a109-373984720fdc tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:55:39.001906 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-3b71f30f-fec5-4d78-a109-373984720fdc tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] [instance: 9db253f7-5a9a-4f18-a021-a6305874dd1f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:55:39.009578 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-3b71f30f-fec5-4d78-a109-373984720fdc tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:55:39.010048 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-3b71f30f-fec5-4d78-a109-373984720fdc tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:55:39.010805 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-3b71f30f-fec5-4d78-a109-373984720fdc tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:55:39.011236 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-3b71f30f-fec5-4d78-a109-373984720fdc tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:55:39.034490 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.objects.instance [None req-3b71f30f-fec5-4d78-a109-373984720fdc tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lazy-loading 'flavor' on Instance uuid 9db253f7-5a9a-4f18-a021-a6305874dd1f {{(pid=124204) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 10:55:39.105523 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-3b71f30f-fec5-4d78-a109-373984720fdc tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] 10.222.0.59 "POST /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f/action" status: 202 len: 0 microversion: 2.1 time: 0.112152 Jun 30 10:55:39.106377 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 585/1188] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Jun 30 10:55:38 2022] POST /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 30 10:55:39.113265 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_api:SELECT=7 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:55:39.114162 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_cell1:SELECT=15 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:55:39.118306 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-0fa5e20e-5fdf-4b1e-988e-757c8b3e38df tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:55:39.119019 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-0fa5e20e-5fdf-4b1e-988e-757c8b3e38df tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] [instance: 9db253f7-5a9a-4f18-a021-a6305874dd1f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:55:39.126509 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0fa5e20e-5fdf-4b1e-988e-757c8b3e38df tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:55:39.126950 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0fa5e20e-5fdf-4b1e-988e-757c8b3e38df tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:55:39.127715 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0fa5e20e-5fdf-4b1e-988e-757c8b3e38df tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:55:39.128147 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-0fa5e20e-5fdf-4b1e-988e-757c8b3e38df tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:55:39.428422 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-0fa5e20e-5fdf-4b1e-988e-757c8b3e38df tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8453bd18330b40af9efac8d72d749141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8819274ed13f4f3f848fb7be9e295815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:55:39.435783 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-0fa5e20e-5fdf-4b1e-988e-757c8b3e38df tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] 10.222.0.59 "GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f" status: 200 len: 1568 microversion: 2.1 time: 0.324920 Jun 30 10:55:39.436330 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 604/1189] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:55:39 2022] GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f => generated 1568 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:55:40.455554 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-e5582fc7-4208-40cd-b9c8-25ea9bbcac0e tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:55:40.456792 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-e5582fc7-4208-40cd-b9c8-25ea9bbcac0e tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] [instance: 9db253f7-5a9a-4f18-a021-a6305874dd1f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:55:40.469805 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO oslo.messaging._drivers.impl_rabbit [-] [f6b7188a-ec1e-4806-a603-a608d9b02a0b] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 57954. Jun 30 10:55:40.471582 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-e5582fc7-4208-40cd-b9c8-25ea9bbcac0e tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:55:40.472032 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-e5582fc7-4208-40cd-b9c8-25ea9bbcac0e tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:55:40.472938 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-e5582fc7-4208-40cd-b9c8-25ea9bbcac0e tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:55:40.473377 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-e5582fc7-4208-40cd-b9c8-25ea9bbcac0e tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:55:40.668030 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-e5582fc7-4208-40cd-b9c8-25ea9bbcac0e tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8453bd18330b40af9efac8d72d749141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8819274ed13f4f3f848fb7be9e295815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:55:40.675441 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-e5582fc7-4208-40cd-b9c8-25ea9bbcac0e tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] 10.222.0.59 "GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f" status: 200 len: 1568 microversion: 2.1 time: 0.225590 Jun 30 10:55:40.675997 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 586/1190] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:55:40 2022] GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f => generated 1568 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:55:41.693112 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-950f9492-ad22-416c-a79f-729a624819a5 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:55:41.693494 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-950f9492-ad22-416c-a79f-729a624819a5 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] [instance: 9db253f7-5a9a-4f18-a021-a6305874dd1f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:55:41.699443 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-950f9492-ad22-416c-a79f-729a624819a5 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:55:41.699891 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-950f9492-ad22-416c-a79f-729a624819a5 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:55:41.700684 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-950f9492-ad22-416c-a79f-729a624819a5 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:55:41.701123 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-950f9492-ad22-416c-a79f-729a624819a5 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:55:41.825756 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-950f9492-ad22-416c-a79f-729a624819a5 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8453bd18330b40af9efac8d72d749141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8819274ed13f4f3f848fb7be9e295815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:55:41.833656 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-950f9492-ad22-416c-a79f-729a624819a5 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] 10.222.0.59 "GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f" status: 200 len: 1568 microversion: 2.1 time: 0.144895 Jun 30 10:55:41.834207 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 605/1191] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:55:41 2022] GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f => generated 1568 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:55:42.851160 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-281f74c1-2669-4b5d-8a52-cd9de35fe941 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:55:42.851786 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-281f74c1-2669-4b5d-8a52-cd9de35fe941 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] [instance: 9db253f7-5a9a-4f18-a021-a6305874dd1f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:55:42.858334 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-281f74c1-2669-4b5d-8a52-cd9de35fe941 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:55:42.858782 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-281f74c1-2669-4b5d-8a52-cd9de35fe941 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:55:42.859545 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-281f74c1-2669-4b5d-8a52-cd9de35fe941 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:55:42.860640 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-281f74c1-2669-4b5d-8a52-cd9de35fe941 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:55:42.992316 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-281f74c1-2669-4b5d-8a52-cd9de35fe941 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8453bd18330b40af9efac8d72d749141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8819274ed13f4f3f848fb7be9e295815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:55:42.999852 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-281f74c1-2669-4b5d-8a52-cd9de35fe941 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] 10.222.0.59 "GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f" status: 200 len: 1568 microversion: 2.1 time: 0.152673 Jun 30 10:55:43.000415 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 587/1192] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:55:42 2022] GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:55:44.016818 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-212b4908-70b3-42cf-be31-91811977c2b2 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:55:44.017340 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-212b4908-70b3-42cf-be31-91811977c2b2 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] [instance: 9db253f7-5a9a-4f18-a021-a6305874dd1f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:55:44.023980 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-212b4908-70b3-42cf-be31-91811977c2b2 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:55:44.024425 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-212b4908-70b3-42cf-be31-91811977c2b2 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:55:44.025289 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-212b4908-70b3-42cf-be31-91811977c2b2 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:55:44.025726 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-212b4908-70b3-42cf-be31-91811977c2b2 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:55:44.156464 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-212b4908-70b3-42cf-be31-91811977c2b2 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8453bd18330b40af9efac8d72d749141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8819274ed13f4f3f848fb7be9e295815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:55:44.164569 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-212b4908-70b3-42cf-be31-91811977c2b2 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] 10.222.0.59 "GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f" status: 200 len: 1568 microversion: 2.1 time: 0.151734 Jun 30 10:55:44.165125 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 606/1193] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:55:44 2022] GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:55:45.182040 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-86abbfac-26b1-45c8-a64f-4ca82349a72f tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:55:45.182636 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-86abbfac-26b1-45c8-a64f-4ca82349a72f tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] [instance: 9db253f7-5a9a-4f18-a021-a6305874dd1f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:55:45.190094 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-86abbfac-26b1-45c8-a64f-4ca82349a72f tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:55:45.190546 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-86abbfac-26b1-45c8-a64f-4ca82349a72f tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:55:45.191316 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-86abbfac-26b1-45c8-a64f-4ca82349a72f tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:55:45.191752 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-86abbfac-26b1-45c8-a64f-4ca82349a72f tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:55:45.321958 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-86abbfac-26b1-45c8-a64f-4ca82349a72f tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8453bd18330b40af9efac8d72d749141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8819274ed13f4f3f848fb7be9e295815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:55:45.329604 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-86abbfac-26b1-45c8-a64f-4ca82349a72f tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] 10.222.0.59 "GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f" status: 200 len: 1568 microversion: 2.1 time: 0.151482 Jun 30 10:55:45.330170 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 588/1194] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:55:45 2022] GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:55:46.346926 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-dc7a6f23-2e23-4607-8aa2-8e9910f80adb tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:55:46.347554 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-dc7a6f23-2e23-4607-8aa2-8e9910f80adb tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] [instance: 9db253f7-5a9a-4f18-a021-a6305874dd1f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:55:46.354276 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-dc7a6f23-2e23-4607-8aa2-8e9910f80adb tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:55:46.354715 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-dc7a6f23-2e23-4607-8aa2-8e9910f80adb tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:55:46.355466 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-dc7a6f23-2e23-4607-8aa2-8e9910f80adb tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:55:46.355896 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-dc7a6f23-2e23-4607-8aa2-8e9910f80adb tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:55:46.488026 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-dc7a6f23-2e23-4607-8aa2-8e9910f80adb tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8453bd18330b40af9efac8d72d749141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8819274ed13f4f3f848fb7be9e295815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:55:46.498814 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-dc7a6f23-2e23-4607-8aa2-8e9910f80adb tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] 10.222.0.59 "GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f" status: 200 len: 1568 microversion: 2.1 time: 0.156254 Jun 30 10:55:46.499744 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 607/1195] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:55:46 2022] GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:55:47.519228 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-14a0c7c4-1105-48c3-bf69-1b3c90ae9019 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:55:47.519794 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-14a0c7c4-1105-48c3-bf69-1b3c90ae9019 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] [instance: 9db253f7-5a9a-4f18-a021-a6305874dd1f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:55:47.526309 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-14a0c7c4-1105-48c3-bf69-1b3c90ae9019 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:55:47.526760 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-14a0c7c4-1105-48c3-bf69-1b3c90ae9019 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:55:47.527516 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-14a0c7c4-1105-48c3-bf69-1b3c90ae9019 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:55:47.527952 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-14a0c7c4-1105-48c3-bf69-1b3c90ae9019 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:55:47.654738 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-14a0c7c4-1105-48c3-bf69-1b3c90ae9019 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8453bd18330b40af9efac8d72d749141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8819274ed13f4f3f848fb7be9e295815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:55:47.662166 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-14a0c7c4-1105-48c3-bf69-1b3c90ae9019 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] 10.222.0.59 "GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f" status: 200 len: 1568 microversion: 2.1 time: 0.147726 Jun 30 10:55:47.662727 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 589/1196] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:55:47 2022] GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:55:48.679324 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-bbd15a11-49b0-4ab9-8c2a-e65af5b0ae8b tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:55:48.679934 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-bbd15a11-49b0-4ab9-8c2a-e65af5b0ae8b tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] [instance: 9db253f7-5a9a-4f18-a021-a6305874dd1f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:55:48.686390 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-bbd15a11-49b0-4ab9-8c2a-e65af5b0ae8b tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:55:48.686839 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-bbd15a11-49b0-4ab9-8c2a-e65af5b0ae8b tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:55:48.687600 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-bbd15a11-49b0-4ab9-8c2a-e65af5b0ae8b tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:55:48.688196 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-bbd15a11-49b0-4ab9-8c2a-e65af5b0ae8b tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:55:48.818746 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-bbd15a11-49b0-4ab9-8c2a-e65af5b0ae8b tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8453bd18330b40af9efac8d72d749141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8819274ed13f4f3f848fb7be9e295815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:55:48.826426 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-bbd15a11-49b0-4ab9-8c2a-e65af5b0ae8b tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] 10.222.0.59 "GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f" status: 200 len: 1568 microversion: 2.1 time: 0.151044 Jun 30 10:55:48.826999 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 608/1197] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:55:48 2022] GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:55:49.843209 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-91db9ccd-1f9a-4680-851c-d968c53ddac0 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:55:49.843954 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-91db9ccd-1f9a-4680-851c-d968c53ddac0 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] [instance: 9db253f7-5a9a-4f18-a021-a6305874dd1f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:55:49.850622 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-91db9ccd-1f9a-4680-851c-d968c53ddac0 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:55:49.851068 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-91db9ccd-1f9a-4680-851c-d968c53ddac0 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:55:49.851830 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-91db9ccd-1f9a-4680-851c-d968c53ddac0 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:55:49.852267 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-91db9ccd-1f9a-4680-851c-d968c53ddac0 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:55:49.978690 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-91db9ccd-1f9a-4680-851c-d968c53ddac0 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8453bd18330b40af9efac8d72d749141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8819274ed13f4f3f848fb7be9e295815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:55:49.986608 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-91db9ccd-1f9a-4680-851c-d968c53ddac0 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] 10.222.0.59 "GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f" status: 200 len: 1568 microversion: 2.1 time: 0.147250 Jun 30 10:55:49.987176 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 590/1198] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:55:49 2022] GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:55:51.004393 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-a4c887ce-2ddd-4c56-aa8d-4b1f152e9f7c tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:55:51.005041 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-a4c887ce-2ddd-4c56-aa8d-4b1f152e9f7c tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] [instance: 9db253f7-5a9a-4f18-a021-a6305874dd1f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:55:51.011567 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a4c887ce-2ddd-4c56-aa8d-4b1f152e9f7c tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:55:51.012037 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a4c887ce-2ddd-4c56-aa8d-4b1f152e9f7c tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:55:51.012831 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a4c887ce-2ddd-4c56-aa8d-4b1f152e9f7c tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:55:51.013272 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a4c887ce-2ddd-4c56-aa8d-4b1f152e9f7c tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:55:51.145293 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-a4c887ce-2ddd-4c56-aa8d-4b1f152e9f7c tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8453bd18330b40af9efac8d72d749141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8819274ed13f4f3f848fb7be9e295815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:55:51.152704 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-a4c887ce-2ddd-4c56-aa8d-4b1f152e9f7c tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] 10.222.0.59 "GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f" status: 200 len: 1568 microversion: 2.1 time: 0.152732 Jun 30 10:55:51.153470 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 609/1199] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:55:50 2022] GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:55:52.171216 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-6f90e9bc-3214-45ea-8370-e57b9a1bed98 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:55:52.171853 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-6f90e9bc-3214-45ea-8370-e57b9a1bed98 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] [instance: 9db253f7-5a9a-4f18-a021-a6305874dd1f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:55:52.179171 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6f90e9bc-3214-45ea-8370-e57b9a1bed98 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:55:52.179611 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6f90e9bc-3214-45ea-8370-e57b9a1bed98 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:55:52.180376 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6f90e9bc-3214-45ea-8370-e57b9a1bed98 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:55:52.180840 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6f90e9bc-3214-45ea-8370-e57b9a1bed98 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:55:52.314638 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-6f90e9bc-3214-45ea-8370-e57b9a1bed98 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8453bd18330b40af9efac8d72d749141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8819274ed13f4f3f848fb7be9e295815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:55:52.322053 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-6f90e9bc-3214-45ea-8370-e57b9a1bed98 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] 10.222.0.59 "GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f" status: 200 len: 1509 microversion: 2.1 time: 0.154822 Jun 30 10:55:52.322643 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 591/1200] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:55:52 2022] GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:55:52.338022 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-b675b96d-6dcd-45c6-8f71-3f8caa5473c7 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:55:52.338595 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-b675b96d-6dcd-45c6-8f71-3f8caa5473c7 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] [instance: 9db253f7-5a9a-4f18-a021-a6305874dd1f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:55:52.345010 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b675b96d-6dcd-45c6-8f71-3f8caa5473c7 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:55:52.345449 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b675b96d-6dcd-45c6-8f71-3f8caa5473c7 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:55:52.346197 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b675b96d-6dcd-45c6-8f71-3f8caa5473c7 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:55:52.346624 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b675b96d-6dcd-45c6-8f71-3f8caa5473c7 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:55:52.433310 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-b675b96d-6dcd-45c6-8f71-3f8caa5473c7 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] 10.222.0.59 "POST /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f/action" status: 202 len: 0 microversion: 2.1 time: 0.099057 Jun 30 10:55:52.434054 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 610/1201] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Jun 30 10:55:52 2022] POST /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 10:55:52.442095 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-df1bf256-3a80-44a7-9c0c-fe069594fa9a tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:55:52.442712 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-df1bf256-3a80-44a7-9c0c-fe069594fa9a tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] [instance: 9db253f7-5a9a-4f18-a021-a6305874dd1f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:55:52.448656 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-df1bf256-3a80-44a7-9c0c-fe069594fa9a tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:55:52.449109 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-df1bf256-3a80-44a7-9c0c-fe069594fa9a tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:55:52.449906 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-df1bf256-3a80-44a7-9c0c-fe069594fa9a tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:55:52.450637 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-df1bf256-3a80-44a7-9c0c-fe069594fa9a tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:55:52.597645 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-df1bf256-3a80-44a7-9c0c-fe069594fa9a tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8453bd18330b40af9efac8d72d749141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8819274ed13f4f3f848fb7be9e295815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:55:52.605263 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-df1bf256-3a80-44a7-9c0c-fe069594fa9a tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] 10.222.0.59 "GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f" status: 200 len: 1517 microversion: 2.1 time: 0.167076 Jun 30 10:55:52.605830 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 592/1202] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:55:52 2022] GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f => generated 1517 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:55:53.623628 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-7dc25e10-9b0b-4399-ab74-49e52839038c tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:55:53.624178 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-7dc25e10-9b0b-4399-ab74-49e52839038c tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] [instance: 9db253f7-5a9a-4f18-a021-a6305874dd1f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:55:53.630563 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-7dc25e10-9b0b-4399-ab74-49e52839038c tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:55:53.631005 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-7dc25e10-9b0b-4399-ab74-49e52839038c tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:55:53.631750 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-7dc25e10-9b0b-4399-ab74-49e52839038c tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:55:53.632179 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-7dc25e10-9b0b-4399-ab74-49e52839038c tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:55:53.764475 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-7dc25e10-9b0b-4399-ab74-49e52839038c tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8453bd18330b40af9efac8d72d749141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8819274ed13f4f3f848fb7be9e295815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:55:53.772786 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-7dc25e10-9b0b-4399-ab74-49e52839038c tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] 10.222.0.59 "GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f" status: 200 len: 1575 microversion: 2.1 time: 0.153543 Jun 30 10:55:53.773390 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 611/1203] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:55:53 2022] GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:55:54.741830 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [req-f512adf8-69a8-4f1f-a878-7affea116cc4 req-d905e028-5758-4598-8c0e-a613777197c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9db253f7-5a9a-4f18-a021-a6305874dd1f", "name": "network-vif-unplugged", "status": "completed", "tag": "9f40ae69-a624-4d1b-be54-aa13e5735312"}]} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:55:54.750407 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-f512adf8-69a8-4f1f-a878-7affea116cc4 req-d905e028-5758-4598-8c0e-a613777197c1 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:55:54.750854 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-f512adf8-69a8-4f1f-a878-7affea116cc4 req-d905e028-5758-4598-8c0e-a613777197c1 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:55:54.762085 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.compute.server_external_events [req-f512adf8-69a8-4f1f-a878-7affea116cc4 req-d905e028-5758-4598-8c0e-a613777197c1 service nova] Creating event network-vif-unplugged:9f40ae69-a624-4d1b-be54-aa13e5735312 for instance 9db253f7-5a9a-4f18-a021-a6305874dd1f on hv-cinder-82282 Jun 30 10:55:54.767489 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [req-f512adf8-69a8-4f1f-a878-7affea116cc4 req-d905e028-5758-4598-8c0e-a613777197c1 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029791 Jun 30 10:55:54.768080 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 593/1204] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:55:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:55:54.790016 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-3749a2d5-1131-4149-b28f-2765c3954758 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:55:54.790623 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-3749a2d5-1131-4149-b28f-2765c3954758 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] [instance: 9db253f7-5a9a-4f18-a021-a6305874dd1f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:55:54.797053 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-3749a2d5-1131-4149-b28f-2765c3954758 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:55:54.797501 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-3749a2d5-1131-4149-b28f-2765c3954758 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:55:54.798263 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-3749a2d5-1131-4149-b28f-2765c3954758 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:55:54.798699 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-3749a2d5-1131-4149-b28f-2765c3954758 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:55:54.927575 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-3749a2d5-1131-4149-b28f-2765c3954758 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8453bd18330b40af9efac8d72d749141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8819274ed13f4f3f848fb7be9e295815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:55:54.934906 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-3749a2d5-1131-4149-b28f-2765c3954758 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] 10.222.0.59 "GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f" status: 200 len: 1575 microversion: 2.1 time: 0.148747 Jun 30 10:55:54.935469 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 612/1205] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:55:54 2022] GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f => generated 1575 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:55:55.952259 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-f5a25701-069d-41be-b86e-858005bee766 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:55:55.952878 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-f5a25701-069d-41be-b86e-858005bee766 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] [instance: 9db253f7-5a9a-4f18-a021-a6305874dd1f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:55:55.959639 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f5a25701-069d-41be-b86e-858005bee766 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:55:55.960077 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f5a25701-069d-41be-b86e-858005bee766 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:55:55.960846 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f5a25701-069d-41be-b86e-858005bee766 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:55:55.961274 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f5a25701-069d-41be-b86e-858005bee766 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:55:56.092056 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-f5a25701-069d-41be-b86e-858005bee766 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8453bd18330b40af9efac8d72d749141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8819274ed13f4f3f848fb7be9e295815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:55:56.099548 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-f5a25701-069d-41be-b86e-858005bee766 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] 10.222.0.59 "GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f" status: 200 len: 1575 microversion: 2.1 time: 0.152072 Jun 30 10:55:56.100103 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 594/1206] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:55:55 2022] GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:55:57.116821 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-c394c088-0b46-40a7-9df0-360020ac7dee tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:55:57.117462 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-c394c088-0b46-40a7-9df0-360020ac7dee tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] [instance: 9db253f7-5a9a-4f18-a021-a6305874dd1f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:55:57.123962 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c394c088-0b46-40a7-9df0-360020ac7dee tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:55:57.124405 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c394c088-0b46-40a7-9df0-360020ac7dee tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:55:57.125800 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c394c088-0b46-40a7-9df0-360020ac7dee tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:55:57.126239 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c394c088-0b46-40a7-9df0-360020ac7dee tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:55:57.256201 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-c394c088-0b46-40a7-9df0-360020ac7dee tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8453bd18330b40af9efac8d72d749141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8819274ed13f4f3f848fb7be9e295815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:55:57.263908 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-c394c088-0b46-40a7-9df0-360020ac7dee tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] 10.222.0.59 "GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f" status: 200 len: 1575 microversion: 2.1 time: 0.151171 Jun 30 10:55:57.264477 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 613/1207] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:55:57 2022] GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:55:58.281248 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-0c4967d5-8791-426b-b487-72c36fcb4cdc tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:55:58.281894 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-0c4967d5-8791-426b-b487-72c36fcb4cdc tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] [instance: 9db253f7-5a9a-4f18-a021-a6305874dd1f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:55:58.288453 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-0c4967d5-8791-426b-b487-72c36fcb4cdc tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:55:58.288944 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-0c4967d5-8791-426b-b487-72c36fcb4cdc tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:55:58.289709 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-0c4967d5-8791-426b-b487-72c36fcb4cdc tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:55:58.290148 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-0c4967d5-8791-426b-b487-72c36fcb4cdc tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:55:58.415798 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-0c4967d5-8791-426b-b487-72c36fcb4cdc tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8453bd18330b40af9efac8d72d749141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8819274ed13f4f3f848fb7be9e295815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:55:58.423337 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-0c4967d5-8791-426b-b487-72c36fcb4cdc tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] 10.222.0.59 "GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f" status: 200 len: 1575 microversion: 2.1 time: 0.146069 Jun 30 10:55:58.423900 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 595/1208] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:55:58 2022] GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f => generated 1575 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:55:59.440269 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-e858ecf0-e342-4d68-bdcb-0b76ad7d6a13 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:55:59.440898 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-e858ecf0-e342-4d68-bdcb-0b76ad7d6a13 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] [instance: 9db253f7-5a9a-4f18-a021-a6305874dd1f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:55:59.447339 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e858ecf0-e342-4d68-bdcb-0b76ad7d6a13 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:55:59.447777 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e858ecf0-e342-4d68-bdcb-0b76ad7d6a13 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:55:59.448552 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e858ecf0-e342-4d68-bdcb-0b76ad7d6a13 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:55:59.448989 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-e858ecf0-e342-4d68-bdcb-0b76ad7d6a13 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:55:59.579389 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-e858ecf0-e342-4d68-bdcb-0b76ad7d6a13 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8453bd18330b40af9efac8d72d749141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8819274ed13f4f3f848fb7be9e295815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:55:59.586865 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-e858ecf0-e342-4d68-bdcb-0b76ad7d6a13 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] 10.222.0.59 "GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f" status: 200 len: 1575 microversion: 2.1 time: 0.150521 Jun 30 10:55:59.587435 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 614/1209] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:55:59 2022] GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:56:00.603999 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-f1435df6-60ab-478d-b198-0c31a4f2323d tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:56:00.604641 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-f1435df6-60ab-478d-b198-0c31a4f2323d tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] [instance: 9db253f7-5a9a-4f18-a021-a6305874dd1f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:56:00.611867 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f1435df6-60ab-478d-b198-0c31a4f2323d tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:56:00.612313 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f1435df6-60ab-478d-b198-0c31a4f2323d tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:56:00.613353 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f1435df6-60ab-478d-b198-0c31a4f2323d tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:56:00.613815 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f1435df6-60ab-478d-b198-0c31a4f2323d tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:56:00.743491 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-f1435df6-60ab-478d-b198-0c31a4f2323d tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8453bd18330b40af9efac8d72d749141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8819274ed13f4f3f848fb7be9e295815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:56:00.751090 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-f1435df6-60ab-478d-b198-0c31a4f2323d tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] 10.222.0.59 "GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f" status: 200 len: 1575 microversion: 2.1 time: 0.150936 Jun 30 10:56:00.751668 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 596/1210] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:56:00 2022] GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:56:01.768372 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-581751ef-f866-4019-b160-c3e8ef88ad8b tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:56:01.769007 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-581751ef-f866-4019-b160-c3e8ef88ad8b tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] [instance: 9db253f7-5a9a-4f18-a021-a6305874dd1f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:56:01.775484 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-581751ef-f866-4019-b160-c3e8ef88ad8b tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:56:01.775928 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-581751ef-f866-4019-b160-c3e8ef88ad8b tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:56:01.776711 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-581751ef-f866-4019-b160-c3e8ef88ad8b tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:56:01.777138 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-581751ef-f866-4019-b160-c3e8ef88ad8b tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:56:01.906702 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-581751ef-f866-4019-b160-c3e8ef88ad8b tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8453bd18330b40af9efac8d72d749141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8819274ed13f4f3f848fb7be9e295815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:56:01.914198 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-581751ef-f866-4019-b160-c3e8ef88ad8b tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] 10.222.0.59 "GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f" status: 200 len: 1575 microversion: 2.1 time: 0.150156 Jun 30 10:56:01.914763 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 615/1211] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:56:01 2022] GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:56:02.880387 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [req-4c061817-bfcc-4033-8b87-55aa5609aa58 req-864b23dd-06fc-4b48-960f-d39db52fba45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9db253f7-5a9a-4f18-a021-a6305874dd1f", "name": "network-vif-plugged", "status": "completed", "tag": "9f40ae69-a624-4d1b-be54-aa13e5735312"}]} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:56:02.889582 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-4c061817-bfcc-4033-8b87-55aa5609aa58 req-864b23dd-06fc-4b48-960f-d39db52fba45 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:56:02.890218 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-4c061817-bfcc-4033-8b87-55aa5609aa58 req-864b23dd-06fc-4b48-960f-d39db52fba45 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:56:02.901944 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.compute.server_external_events [req-4c061817-bfcc-4033-8b87-55aa5609aa58 req-864b23dd-06fc-4b48-960f-d39db52fba45 service nova] Creating event network-vif-plugged:9f40ae69-a624-4d1b-be54-aa13e5735312 for instance 9db253f7-5a9a-4f18-a021-a6305874dd1f on hv-cinder-82282 Jun 30 10:56:02.907421 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [req-4c061817-bfcc-4033-8b87-55aa5609aa58 req-864b23dd-06fc-4b48-960f-d39db52fba45 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030832 Jun 30 10:56:02.908355 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 597/1212] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:56:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:56:02.932283 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-ea0c7d1f-6c55-40b6-825c-25e31e84e42c tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:56:02.932926 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-ea0c7d1f-6c55-40b6-825c-25e31e84e42c tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] [instance: 9db253f7-5a9a-4f18-a021-a6305874dd1f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:56:02.940915 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ea0c7d1f-6c55-40b6-825c-25e31e84e42c tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:56:02.941356 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ea0c7d1f-6c55-40b6-825c-25e31e84e42c tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:56:02.942726 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ea0c7d1f-6c55-40b6-825c-25e31e84e42c tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:56:02.943362 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ea0c7d1f-6c55-40b6-825c-25e31e84e42c tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:56:03.078919 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-ea0c7d1f-6c55-40b6-825c-25e31e84e42c tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8453bd18330b40af9efac8d72d749141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8819274ed13f4f3f848fb7be9e295815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:56:03.086492 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-ea0c7d1f-6c55-40b6-825c-25e31e84e42c tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] 10.222.0.59 "GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f" status: 200 len: 1575 microversion: 2.1 time: 0.159316 Jun 30 10:56:03.087007 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 616/1213] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:56:02 2022] GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:56:04.105246 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-29848b99-5b14-4a4e-86cd-17a9f3c2e83a tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:56:04.105870 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-29848b99-5b14-4a4e-86cd-17a9f3c2e83a tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] [instance: 9db253f7-5a9a-4f18-a021-a6305874dd1f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:56:04.111995 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-29848b99-5b14-4a4e-86cd-17a9f3c2e83a tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:56:04.112436 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-29848b99-5b14-4a4e-86cd-17a9f3c2e83a tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:56:04.113476 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-29848b99-5b14-4a4e-86cd-17a9f3c2e83a tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:56:04.113908 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-29848b99-5b14-4a4e-86cd-17a9f3c2e83a tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:56:04.245860 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-29848b99-5b14-4a4e-86cd-17a9f3c2e83a tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8453bd18330b40af9efac8d72d749141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8819274ed13f4f3f848fb7be9e295815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:56:04.253834 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-29848b99-5b14-4a4e-86cd-17a9f3c2e83a tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] 10.222.0.59 "GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f" status: 200 len: 1562 microversion: 2.1 time: 0.153473 Jun 30 10:56:04.254395 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 598/1214] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:56:04 2022] GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f => generated 1562 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:56:57.053807 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 10:56:57.054523 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Thu Jun 30 10:56:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 10:57:14.595626 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 10:57:14.596242 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Thu Jun 30 10:57:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 10:57:31.998519 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_api:SELECT=28 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:57:32.002499 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_api:SELECT=28 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:57:32.003549 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:57:32.003876 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:57:32.008158 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-48b06133-7052-4456-a88b-2d63fe0f7bac tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:57:32.012077 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [req-0ec8eb60-3a71-4711-8fdf-9c51eba79827 req-3459dc5e-d59b-4b69-b3b5-f2f886b04dab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9db253f7-5a9a-4f18-a021-a6305874dd1f", "tag": "9f40ae69-a624-4d1b-be54-aa13e5735312"}]} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:57:32.013067 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-48b06133-7052-4456-a88b-2d63fe0f7bac tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] [instance: 9db253f7-5a9a-4f18-a021-a6305874dd1f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:57:32.021449 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-48b06133-7052-4456-a88b-2d63fe0f7bac tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:57:32.021937 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-48b06133-7052-4456-a88b-2d63fe0f7bac tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:57:32.022322 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-0ec8eb60-3a71-4711-8fdf-9c51eba79827 req-3459dc5e-d59b-4b69-b3b5-f2f886b04dab service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:57:32.022710 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-48b06133-7052-4456-a88b-2d63fe0f7bac tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:57:32.022845 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-0ec8eb60-3a71-4711-8fdf-9c51eba79827 req-3459dc5e-d59b-4b69-b3b5-f2f886b04dab service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:57:32.023138 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-48b06133-7052-4456-a88b-2d63fe0f7bac tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:57:32.038934 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.compute.server_external_events [req-0ec8eb60-3a71-4711-8fdf-9c51eba79827 req-3459dc5e-d59b-4b69-b3b5-f2f886b04dab service nova] Creating event network-changed:9f40ae69-a624-4d1b-be54-aa13e5735312 for instance 9db253f7-5a9a-4f18-a021-a6305874dd1f on hv-cinder-82282 Jun 30 10:57:32.045265 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [req-0ec8eb60-3a71-4711-8fdf-9c51eba79827 req-3459dc5e-d59b-4b69-b3b5-f2f886b04dab service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044825 Jun 30 10:57:32.045898 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 599/1215] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:57:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:57:32.050300 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-48b06133-7052-4456-a88b-2d63fe0f7bac tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] [instance: 9db253f7-5a9a-4f18-a021-a6305874dd1f] Going to try to terminate instance {{(pid=124203) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 10:57:32.142383 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-48b06133-7052-4456-a88b-2d63fe0f7bac tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] 10.222.0.59 "DELETE /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f" status: 204 len: 0 microversion: 2.1 time: 0.144462 Jun 30 10:57:32.144387 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 617/1216] 10.222.0.59 () {58 vars in 1238 bytes} [Thu Jun 30 10:57:31 2022] DELETE /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 10:57:32.153251 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-1775ee2c-c931-4e64-af88-7a46aaeaa00c tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:57:32.154207 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-1775ee2c-c931-4e64-af88-7a46aaeaa00c tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] [instance: 9db253f7-5a9a-4f18-a021-a6305874dd1f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:57:32.160802 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1775ee2c-c931-4e64-af88-7a46aaeaa00c tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:57:32.161252 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1775ee2c-c931-4e64-af88-7a46aaeaa00c tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:57:32.162129 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1775ee2c-c931-4e64-af88-7a46aaeaa00c tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:57:32.162540 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1775ee2c-c931-4e64-af88-7a46aaeaa00c tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:57:32.304613 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-1775ee2c-c931-4e64-af88-7a46aaeaa00c tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8453bd18330b40af9efac8d72d749141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8819274ed13f4f3f848fb7be9e295815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:57:32.312236 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-1775ee2c-c931-4e64-af88-7a46aaeaa00c tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] 10.222.0.59 "GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f" status: 200 len: 1568 microversion: 2.1 time: 0.164258 Jun 30 10:57:32.313080 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 600/1217] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:57:32 2022] GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:57:33.450157 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-924b72a7-9e18-4fed-8b93-f5c49ecf421c tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:57:33.450860 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-924b72a7-9e18-4fed-8b93-f5c49ecf421c tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] [instance: 9db253f7-5a9a-4f18-a021-a6305874dd1f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:57:33.457385 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-924b72a7-9e18-4fed-8b93-f5c49ecf421c tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:57:33.457832 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-924b72a7-9e18-4fed-8b93-f5c49ecf421c tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:57:33.458606 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-924b72a7-9e18-4fed-8b93-f5c49ecf421c tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:57:33.459034 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-924b72a7-9e18-4fed-8b93-f5c49ecf421c tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:57:33.595058 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-924b72a7-9e18-4fed-8b93-f5c49ecf421c tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8453bd18330b40af9efac8d72d749141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8819274ed13f4f3f848fb7be9e295815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:57:33.602615 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-924b72a7-9e18-4fed-8b93-f5c49ecf421c tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] 10.222.0.59 "GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f" status: 200 len: 1568 microversion: 2.1 time: 0.276789 Jun 30 10:57:33.603182 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 618/1218] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:57:33 2022] GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f => generated 1568 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:57:34.429867 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [req-39dbdbe3-3dbb-4f91-9b2d-74d16960bd33 req-247c9804-f930-41b0-89da-a34c05fa4691 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9db253f7-5a9a-4f18-a021-a6305874dd1f", "name": "network-vif-deleted", "tag": "9f40ae69-a624-4d1b-be54-aa13e5735312"}]} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:57:34.437813 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-39dbdbe3-3dbb-4f91-9b2d-74d16960bd33 req-247c9804-f930-41b0-89da-a34c05fa4691 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:57:34.438253 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-39dbdbe3-3dbb-4f91-9b2d-74d16960bd33 req-247c9804-f930-41b0-89da-a34c05fa4691 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:57:34.448866 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.compute.server_external_events [req-39dbdbe3-3dbb-4f91-9b2d-74d16960bd33 req-247c9804-f930-41b0-89da-a34c05fa4691 service nova] Creating event network-vif-deleted:9f40ae69-a624-4d1b-be54-aa13e5735312 for instance 9db253f7-5a9a-4f18-a021-a6305874dd1f on hv-cinder-82282 Jun 30 10:57:34.454162 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [req-39dbdbe3-3dbb-4f91-9b2d-74d16960bd33 req-247c9804-f930-41b0-89da-a34c05fa4691 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090769 Jun 30 10:57:34.454721 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 601/1219] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:57:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:57:34.620788 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-aefff9e2-ae30-44d5-9bac-e1ce4112eb24 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:57:34.621417 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-aefff9e2-ae30-44d5-9bac-e1ce4112eb24 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] [instance: 9db253f7-5a9a-4f18-a021-a6305874dd1f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:57:34.628841 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-aefff9e2-ae30-44d5-9bac-e1ce4112eb24 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:57:34.629518 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-aefff9e2-ae30-44d5-9bac-e1ce4112eb24 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:57:34.630476 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-aefff9e2-ae30-44d5-9bac-e1ce4112eb24 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:57:34.631101 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-aefff9e2-ae30-44d5-9bac-e1ce4112eb24 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:57:34.696456 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-aefff9e2-ae30-44d5-9bac-e1ce4112eb24 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8453bd18330b40af9efac8d72d749141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8819274ed13f4f3f848fb7be9e295815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:57:34.704581 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-aefff9e2-ae30-44d5-9bac-e1ce4112eb24 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] 10.222.0.59 "GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f" status: 200 len: 1220 microversion: 2.1 time: 0.087723 Jun 30 10:57:34.705147 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 619/1220] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:57:34 2022] GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:57:35.722857 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-cd2823ea-fed9-4218-8d12-91c02ff83b39 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:57:35.723565 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-cd2823ea-fed9-4218-8d12-91c02ff83b39 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] [instance: 9db253f7-5a9a-4f18-a021-a6305874dd1f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:57:35.729756 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-cd2823ea-fed9-4218-8d12-91c02ff83b39 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:57:35.730207 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-cd2823ea-fed9-4218-8d12-91c02ff83b39 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:57:35.730971 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-cd2823ea-fed9-4218-8d12-91c02ff83b39 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:57:35.731412 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-cd2823ea-fed9-4218-8d12-91c02ff83b39 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:57:35.745569 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.wsgi [None req-cd2823ea-fed9-4218-8d12-91c02ff83b39 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] HTTP exception thrown: Instance 9db253f7-5a9a-4f18-a021-a6305874dd1f could not be found. Jun 30 10:57:35.747192 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-cd2823ea-fed9-4218-8d12-91c02ff83b39 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Request method failure captured: Jun 30 10:57:35.747192 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: request: GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f HTTP/1.1 Jun 30 10:57:35.747192 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Accept: application/json Jun 30 10:57:35.747192 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Accept-Encoding: identity Jun 30 10:57:35.747192 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Connection: close Jun 30 10:57:35.747192 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Content-Length: 0 Jun 30 10:57:35.747192 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Content-Type: application/json Jun 30 10:57:35.747192 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Host: 10.222.0.59 Jun 30 10:57:35.747192 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Openstack-System-Scope: None Jun 30 10:57:35.747192 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: User-Agent: python-urllib3/1.26.9 Jun 30 10:57:35.747192 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Auth-Token: gAAAAABivYBqhWaLRPtHcSKDAvBl7pGQ_2PpITtTjtMFZh0QM6w2MUYJ9SjJTTYt2YTuEV_ZLVaAjtmX8n7zbywax6CX06Ty9G6TyF8MV41uh4cJObTedl7FurazKUYyL2VkI664QS0IDGc4uhwnh6QHiWDGxYF4lQ-XH4ZVdY84y7A_OwkUK0I Jun 30 10:57:35.747192 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Domain-Id: None Jun 30 10:57:35.747192 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Domain-Name: None Jun 30 10:57:35.747192 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Identity-Status: Confirmed Jun 30 10:57:35.747192 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Is-Admin-Project: True Jun 30 10:57:35.747192 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Domain-Id: default Jun 30 10:57:35.747192 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Domain-Name: Default Jun 30 10:57:35.747192 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Id: 8819274ed13f4f3f848fb7be9e295815 Jun 30 10:57:35.747192 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Name: tempest-TestShelveInstance-393730116 Jun 30 10:57:35.747192 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Role: member,reader Jun 30 10:57:35.747192 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Roles: member,reader Jun 30 10:57:35.748891 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/8819274ed13f4f3f848fb7be9e295815"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_8819274ed13f4f3f848fb7be9e295815"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/8819274ed13f4f3f848fb7be9e295815"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/8819274ed13f4f3f848fb7be9e295815"}]}] Jun 30 10:57:35.748891 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant: tempest-TestShelveInstance-393730116 Jun 30 10:57:35.748891 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant-Id: 8819274ed13f4f3f848fb7be9e295815 Jun 30 10:57:35.748891 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant-Name: tempest-TestShelveInstance-393730116 Jun 30 10:57:35.748891 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User: tempest-TestShelveInstance-393730116-project Jun 30 10:57:35.748891 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Domain-Id: default Jun 30 10:57:35.748891 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Domain-Name: Default Jun 30 10:57:35.748891 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Id: 8453bd18330b40af9efac8d72d749141 Jun 30 10:57:35.748891 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Name: tempest-TestShelveInstance-393730116-project Jun 30 10:57:35.748891 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: method: > Jun 30 10:57:35.748891 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: exception: Instance 9db253f7-5a9a-4f18-a021-a6305874dd1f could not be found. Jun 30 10:57:35.748891 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: action_args: {'id': '9db253f7-5a9a-4f18-a021-a6305874dd1f'} Jun 30 10:57:35.749902 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:57:35.749902 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:57:35.749902 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 10:57:35.749902 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 10:57:35.749902 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 10:57:35.749902 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 10:57:35.749902 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 10:57:35.749902 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 10:57:35.749902 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 10:57:35.749902 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 10:57:35.749902 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9db253f7-5a9a-4f18-a021-a6305874dd1f could not be found. Jun 30 10:57:35.749902 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:57:35.749902 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:57:35.749902 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:57:35.749902 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:57:35.749902 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:57:35.749902 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:57:35.749902 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:57:35.749902 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:57:35.749902 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:57:35.751496 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:57:35.751496 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 10:57:35.751496 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 10:57:35.751496 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 10:57:35.751496 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 10:57:35.751496 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 10:57:35.751496 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:57:35.751496 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9db253f7-5a9a-4f18-a021-a6305874dd1f could not be found. Jun 30 10:57:35.751496 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:57:35.751496 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:57:35.751496 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:57:35.751496 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:57:35.751496 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:57:35.751496 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:57:35.751496 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:57:35.751496 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:57:35.751496 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9db253f7-5a9a-4f18-a021-a6305874dd1f could not be found. Jun 30 10:57:35.751496 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 10:57:35.752950 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-cd2823ea-fed9-4218-8d12-91c02ff83b39 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Returning 404 to user: Instance 9db253f7-5a9a-4f18-a021-a6305874dd1f could not be found. {{(pid=124204) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:57:35.752950 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-cd2823ea-fed9-4218-8d12-91c02ff83b39 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] 10.222.0.59 "GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f" status: 404 len: 111 microversion: 2.1 time: 0.030953 Jun 30 10:57:35.752950 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 602/1221] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:57:35 2022] GET /compute/v2.1/servers/9db253f7-5a9a-4f18-a021-a6305874dd1f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 10:57:35.908602 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-39ce57b7-617a-4e54-840d-1b0c5826cfa1 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] Calling method '.version_select at 0x7f4dadd63820>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:57:35.930564 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-39ce57b7-617a-4e54-840d-1b0c5826cfa1 tempest-TestShelveInstance-393730116 tempest-TestShelveInstance-393730116-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1596741002" status: 202 len: 0 microversion: 2.1 time: 0.026609 Jun 30 10:57:35.930926 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 620/1222] 10.222.0.59 () {58 vars in 1253 bytes} [Thu Jun 30 10:57:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1596741002 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 10:57:52.488796 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_api:SELECT=8 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:57:52.490460 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_cell1:SELECT=12 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:57:52.659587 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-38c5ce73-e121-4e66-8926-85f40df134ab tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Action: 'create', calling method: .version_select at 0x7f4dadf3dc10>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1197647493", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJOD6CyEMZXVid916ZdM9Sdx6h8310giVzmwlqEcGjLD546D2aQSCURE6y5YPY5nzMfSD1qPuoeIjGyuw1c8t+z4EGWVmfgmlAsAt9bPZcastdsAM8FSx0105gLck+EKng=="}} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:57:52.675232 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.quota [None req-38c5ce73-e121-4e66-8926-85f40df134ab tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Getting quotas for project 5c0e9dab1a604c38a20588ca05dae79c. Resources: {'key_pairs'} {{(pid=124204) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 10:57:52.679677 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.quota [None req-38c5ce73-e121-4e66-8926-85f40df134ab tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Getting quotas for user 30cb785bf7de43e7827371820617997a and project 5c0e9dab1a604c38a20588ca05dae79c. Resources: {'key_pairs'} {{(pid=124204) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 10:57:52.709640 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-38c5ce73-e121-4e66-8926-85f40df134ab tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.226438 Jun 30 10:57:52.715212 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 603/1223] 10.222.0.59 () {60 vars in 1158 bytes} [Thu Jun 30 10:57:52 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:58:16.182973 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:58:16.183711 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:58:16.187633 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-c29a4600-a89b-43e7-9dc7-678e073cc54d tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-631363912", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1197647493", "security_groups": [{"name": "tempest-secgroup-smoke-1530973117"}], "block_device_mapping_v2": [{"uuid": "29f4c693-f84a-42db-a17d-6ce4949e3bb3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a07943fc-a493-40c6-8bff-70034a7afb3d"}]}} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:58:16.300214 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.network.neutron [None req-c29a4600-a89b-43e7-9dc7-678e073cc54d tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] validate_networks() for [('a07943fc-a493-40c6-8bff-70034a7afb3d', None, None, None, None, None)] {{(pid=124203) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 10:58:16.745899 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.virt.hardware [None req-c29a4600-a89b-43e7-9dc7-678e073cc54d tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Flavor limits 0:0:0 {{(pid=124203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 10:58:16.746327 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.virt.hardware [None req-c29a4600-a89b-43e7-9dc7-678e073cc54d tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Image limits 0:0:0 {{(pid=124203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 10:58:16.746834 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.virt.hardware [None req-c29a4600-a89b-43e7-9dc7-678e073cc54d tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Flavor pref 0:0:0 {{(pid=124203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 10:58:16.747248 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.virt.hardware [None req-c29a4600-a89b-43e7-9dc7-678e073cc54d tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Image pref 0:0:0 {{(pid=124203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 10:58:16.747686 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.virt.hardware [None req-c29a4600-a89b-43e7-9dc7-678e073cc54d tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 10:58:16.756407 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c29a4600-a89b-43e7-9dc7-678e073cc54d tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:58:16.756882 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c29a4600-a89b-43e7-9dc7-678e073cc54d tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:58:16.757681 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c29a4600-a89b-43e7-9dc7-678e073cc54d tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:58:16.758117 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c29a4600-a89b-43e7-9dc7-678e073cc54d tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:58:16.775020 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.quota [None req-c29a4600-a89b-43e7-9dc7-678e073cc54d tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Getting quotas for project 5c0e9dab1a604c38a20588ca05dae79c. Resources: {'instances', 'cores', 'ram'} {{(pid=124203) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 10:58:16.778963 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.quota [None req-c29a4600-a89b-43e7-9dc7-678e073cc54d tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Getting quotas for user 30cb785bf7de43e7827371820617997a and project 5c0e9dab1a604c38a20588ca05dae79c. Resources: {'instances', 'cores', 'ram'} {{(pid=124203) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 10:58:16.836225 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-c29a4600-a89b-43e7-9dc7-678e073cc54d tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Going to run 1 instances... {{(pid=124203) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 10:58:16.838324 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-c29a4600-a89b-43e7-9dc7-678e073cc54d tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] [instance: bf1fb171-af43-4eca-84ca-89661ae26efa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='29f4c693-f84a-42db-a17d-6ce4949e3bb3',volume_size=None,volume_type=None)] {{(pid=124203) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 10:58:16.959068 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c29a4600-a89b-43e7-9dc7-678e073cc54d tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] [868465c7-c1c5-48d6-a675-60fa138bb34c] AMQP server on 10.222.0.59:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 30 10:58:17.967606 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO oslo.messaging._drivers.impl_rabbit [None req-c29a4600-a89b-43e7-9dc7-678e073cc54d tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] [868465c7-c1c5-48d6-a675-60fa138bb34c] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 58336. Jun 30 10:58:17.971891 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-c29a4600-a89b-43e7-9dc7-678e073cc54d tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.790414 Jun 30 10:58:17.972555 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 621/1224] 10.222.0.59 () {60 vars in 1146 bytes} [Thu Jun 30 10:58:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 1792 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 10:58:17.979823 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_cell0:SELECT=4 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:58:17.981438 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:58:17.986033 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-f89ad762-6ba0-4e0b-adf0-a70f8a4fafe0 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:58:17.986636 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-f89ad762-6ba0-4e0b-adf0-a70f8a4fafe0 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] [instance: bf1fb171-af43-4eca-84ca-89661ae26efa] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:58:18.043819 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-f89ad762-6ba0-4e0b-adf0-a70f8a4fafe0 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cb785bf7de43e7827371820617997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0e9dab1a604c38a20588ca05dae79c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:58:18.050586 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-f89ad762-6ba0-4e0b-adf0-a70f8a4fafe0 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] 10.222.0.59 "GET /compute/v2.1/servers/bf1fb171-af43-4eca-84ca-89661ae26efa" status: 200 len: 1094 microversion: 2.1 time: 0.072057 Jun 30 10:58:18.051405 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 604/1225] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:58:17 2022] GET /compute/v2.1/servers/bf1fb171-af43-4eca-84ca-89661ae26efa => generated 1094 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:58:19.068978 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-9ad370b1-5e97-43b2-9d1d-a43cb6ae1ced tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:58:19.069662 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-9ad370b1-5e97-43b2-9d1d-a43cb6ae1ced tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] [instance: bf1fb171-af43-4eca-84ca-89661ae26efa] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:58:19.075577 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-9ad370b1-5e97-43b2-9d1d-a43cb6ae1ced tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:58:19.076025 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-9ad370b1-5e97-43b2-9d1d-a43cb6ae1ced tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:58:19.076813 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-9ad370b1-5e97-43b2-9d1d-a43cb6ae1ced tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:58:19.077248 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-9ad370b1-5e97-43b2-9d1d-a43cb6ae1ced tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:58:19.150922 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-9ad370b1-5e97-43b2-9d1d-a43cb6ae1ced tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cb785bf7de43e7827371820617997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0e9dab1a604c38a20588ca05dae79c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:58:19.159072 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-9ad370b1-5e97-43b2-9d1d-a43cb6ae1ced tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] 10.222.0.59 "GET /compute/v2.1/servers/bf1fb171-af43-4eca-84ca-89661ae26efa" status: 200 len: 1210 microversion: 2.1 time: 0.094948 Jun 30 10:58:19.159615 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 622/1226] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:58:19 2022] GET /compute/v2.1/servers/bf1fb171-af43-4eca-84ca-89661ae26efa => generated 1210 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:58:20.177519 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-c099eaf1-ddf8-4b6f-860c-238544601520 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:58:20.178304 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-c099eaf1-ddf8-4b6f-860c-238544601520 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] [instance: bf1fb171-af43-4eca-84ca-89661ae26efa] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:58:20.184626 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c099eaf1-ddf8-4b6f-860c-238544601520 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:58:20.185086 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c099eaf1-ddf8-4b6f-860c-238544601520 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:58:20.185849 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c099eaf1-ddf8-4b6f-860c-238544601520 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:58:20.186287 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c099eaf1-ddf8-4b6f-860c-238544601520 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:58:20.318316 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-c099eaf1-ddf8-4b6f-860c-238544601520 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cb785bf7de43e7827371820617997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0e9dab1a604c38a20588ca05dae79c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:58:20.325818 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-c099eaf1-ddf8-4b6f-860c-238544601520 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] 10.222.0.59 "GET /compute/v2.1/servers/bf1fb171-af43-4eca-84ca-89661ae26efa" status: 200 len: 1266 microversion: 2.1 time: 0.152260 Jun 30 10:58:20.326393 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 605/1227] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:58:20 2022] GET /compute/v2.1/servers/bf1fb171-af43-4eca-84ca-89661ae26efa => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:58:20.567284 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [req-adaeec1c-3888-46b3-885c-e513abf5e3c1 req-8a5aa2f4-9a57-49a4-bd34-fde0668390a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf1fb171-af43-4eca-84ca-89661ae26efa", "tag": "118c8c6d-5238-44e6-9e33-1182fb60a562"}]} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:58:20.588075 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-adaeec1c-3888-46b3-885c-e513abf5e3c1 req-8a5aa2f4-9a57-49a4-bd34-fde0668390a6 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:58:20.588973 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-adaeec1c-3888-46b3-885c-e513abf5e3c1 req-8a5aa2f4-9a57-49a4-bd34-fde0668390a6 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:58:20.616182 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.compute.server_external_events [req-adaeec1c-3888-46b3-885c-e513abf5e3c1 req-8a5aa2f4-9a57-49a4-bd34-fde0668390a6 service nova] Creating event network-changed:118c8c6d-5238-44e6-9e33-1182fb60a562 for instance bf1fb171-af43-4eca-84ca-89661ae26efa on hv-cinder-82282 Jun 30 10:58:20.623028 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [req-adaeec1c-3888-46b3-885c-e513abf5e3c1 req-8a5aa2f4-9a57-49a4-bd34-fde0668390a6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067914 Jun 30 10:58:20.623947 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 623/1228] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:58:21.342663 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-a7a49607-e893-4094-a871-8a157dc8a16d tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:58:21.343284 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-a7a49607-e893-4094-a871-8a157dc8a16d tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] [instance: bf1fb171-af43-4eca-84ca-89661ae26efa] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:58:21.350406 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a7a49607-e893-4094-a871-8a157dc8a16d tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:58:21.350853 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a7a49607-e893-4094-a871-8a157dc8a16d tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:58:21.351616 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a7a49607-e893-4094-a871-8a157dc8a16d tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:58:21.352052 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-a7a49607-e893-4094-a871-8a157dc8a16d tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:58:21.499186 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-a7a49607-e893-4094-a871-8a157dc8a16d tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cb785bf7de43e7827371820617997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0e9dab1a604c38a20588ca05dae79c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:58:21.507157 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-a7a49607-e893-4094-a871-8a157dc8a16d tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] 10.222.0.59 "GET /compute/v2.1/servers/bf1fb171-af43-4eca-84ca-89661ae26efa" status: 200 len: 1266 microversion: 2.1 time: 0.168426 Jun 30 10:58:21.507746 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 606/1229] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:58:21 2022] GET /compute/v2.1/servers/bf1fb171-af43-4eca-84ca-89661ae26efa => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:58:22.526954 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-d845ee06-f613-44fc-9ceb-088bb23d0616 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:58:22.527682 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-d845ee06-f613-44fc-9ceb-088bb23d0616 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] [instance: bf1fb171-af43-4eca-84ca-89661ae26efa] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:58:22.536676 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-d845ee06-f613-44fc-9ceb-088bb23d0616 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:58:22.537130 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-d845ee06-f613-44fc-9ceb-088bb23d0616 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:58:22.537905 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-d845ee06-f613-44fc-9ceb-088bb23d0616 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:58:22.538344 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-d845ee06-f613-44fc-9ceb-088bb23d0616 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:58:22.667526 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-d845ee06-f613-44fc-9ceb-088bb23d0616 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cb785bf7de43e7827371820617997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0e9dab1a604c38a20588ca05dae79c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:58:22.675077 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-d845ee06-f613-44fc-9ceb-088bb23d0616 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] 10.222.0.59 "GET /compute/v2.1/servers/bf1fb171-af43-4eca-84ca-89661ae26efa" status: 200 len: 1266 microversion: 2.1 time: 0.154411 Jun 30 10:58:22.675638 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 624/1230] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:58:22 2022] GET /compute/v2.1/servers/bf1fb171-af43-4eca-84ca-89661ae26efa => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:58:23.691624 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-c3180411-2e44-46e2-bdc9-e0c089dff0ab tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:58:23.692257 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-c3180411-2e44-46e2-bdc9-e0c089dff0ab tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] [instance: bf1fb171-af43-4eca-84ca-89661ae26efa] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:58:23.698678 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c3180411-2e44-46e2-bdc9-e0c089dff0ab tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:58:23.699116 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c3180411-2e44-46e2-bdc9-e0c089dff0ab tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:58:23.699867 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c3180411-2e44-46e2-bdc9-e0c089dff0ab tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:58:23.700291 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-c3180411-2e44-46e2-bdc9-e0c089dff0ab tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:58:23.826376 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-c3180411-2e44-46e2-bdc9-e0c089dff0ab tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cb785bf7de43e7827371820617997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0e9dab1a604c38a20588ca05dae79c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:58:23.834463 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-c3180411-2e44-46e2-bdc9-e0c089dff0ab tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] 10.222.0.59 "GET /compute/v2.1/servers/bf1fb171-af43-4eca-84ca-89661ae26efa" status: 200 len: 1266 microversion: 2.1 time: 0.147219 Jun 30 10:58:23.835038 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 607/1231] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:58:23 2022] GET /compute/v2.1/servers/bf1fb171-af43-4eca-84ca-89661ae26efa => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:58:24.851017 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-c0326b83-1482-47ff-87bd-171500ae105b tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:58:24.851666 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-c0326b83-1482-47ff-87bd-171500ae105b tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] [instance: bf1fb171-af43-4eca-84ca-89661ae26efa] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:58:24.858204 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c0326b83-1482-47ff-87bd-171500ae105b tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:58:24.858656 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c0326b83-1482-47ff-87bd-171500ae105b tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:58:24.859422 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c0326b83-1482-47ff-87bd-171500ae105b tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:58:24.859859 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c0326b83-1482-47ff-87bd-171500ae105b tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:58:24.991598 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-c0326b83-1482-47ff-87bd-171500ae105b tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cb785bf7de43e7827371820617997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0e9dab1a604c38a20588ca05dae79c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:58:24.998960 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-c0326b83-1482-47ff-87bd-171500ae105b tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] 10.222.0.59 "GET /compute/v2.1/servers/bf1fb171-af43-4eca-84ca-89661ae26efa" status: 200 len: 1266 microversion: 2.1 time: 0.151827 Jun 30 10:58:24.999543 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 625/1232] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:58:24 2022] GET /compute/v2.1/servers/bf1fb171-af43-4eca-84ca-89661ae26efa => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:58:26.014784 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-d161f8eb-7f2c-4570-a4f5-a4e69b2f22cd tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:58:26.016009 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-d161f8eb-7f2c-4570-a4f5-a4e69b2f22cd tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] [instance: bf1fb171-af43-4eca-84ca-89661ae26efa] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:58:26.022483 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d161f8eb-7f2c-4570-a4f5-a4e69b2f22cd tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:58:26.022926 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d161f8eb-7f2c-4570-a4f5-a4e69b2f22cd tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:58:26.023692 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d161f8eb-7f2c-4570-a4f5-a4e69b2f22cd tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:58:26.024130 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-d161f8eb-7f2c-4570-a4f5-a4e69b2f22cd tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:58:26.152941 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-d161f8eb-7f2c-4570-a4f5-a4e69b2f22cd tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cb785bf7de43e7827371820617997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0e9dab1a604c38a20588ca05dae79c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:58:26.160337 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-d161f8eb-7f2c-4570-a4f5-a4e69b2f22cd tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] 10.222.0.59 "GET /compute/v2.1/servers/bf1fb171-af43-4eca-84ca-89661ae26efa" status: 200 len: 1266 microversion: 2.1 time: 0.149441 Jun 30 10:58:26.160939 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 608/1233] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:58:26 2022] GET /compute/v2.1/servers/bf1fb171-af43-4eca-84ca-89661ae26efa => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:58:27.177061 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-85bef73b-7992-452d-8e09-719809e5409c tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:58:27.177664 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-85bef73b-7992-452d-8e09-719809e5409c tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] [instance: bf1fb171-af43-4eca-84ca-89661ae26efa] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:58:27.180028 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_cell0:SELECT=2 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:58:27.180720 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_cell0:SELECT=6 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:58:27.186483 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-85bef73b-7992-452d-8e09-719809e5409c tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:58:27.186924 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-85bef73b-7992-452d-8e09-719809e5409c tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:58:27.187674 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-85bef73b-7992-452d-8e09-719809e5409c tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:58:27.188102 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-85bef73b-7992-452d-8e09-719809e5409c tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:58:27.318172 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-85bef73b-7992-452d-8e09-719809e5409c tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cb785bf7de43e7827371820617997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0e9dab1a604c38a20588ca05dae79c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:58:27.325578 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-85bef73b-7992-452d-8e09-719809e5409c tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] 10.222.0.59 "GET /compute/v2.1/servers/bf1fb171-af43-4eca-84ca-89661ae26efa" status: 200 len: 1266 microversion: 2.1 time: 0.152342 Jun 30 10:58:27.326145 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 626/1234] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:58:27 2022] GET /compute/v2.1/servers/bf1fb171-af43-4eca-84ca-89661ae26efa => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:58:28.342233 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-f3f5d75c-4fbf-4799-b71a-dbfb15c40128 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:58:28.342845 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-f3f5d75c-4fbf-4799-b71a-dbfb15c40128 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] [instance: bf1fb171-af43-4eca-84ca-89661ae26efa] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:58:28.345727 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_cell0:SELECT=2 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:58:28.351084 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f3f5d75c-4fbf-4799-b71a-dbfb15c40128 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:58:28.351528 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f3f5d75c-4fbf-4799-b71a-dbfb15c40128 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:58:28.352291 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f3f5d75c-4fbf-4799-b71a-dbfb15c40128 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:58:28.352752 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f3f5d75c-4fbf-4799-b71a-dbfb15c40128 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:58:28.482728 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-f3f5d75c-4fbf-4799-b71a-dbfb15c40128 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cb785bf7de43e7827371820617997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0e9dab1a604c38a20588ca05dae79c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:58:28.490982 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-f3f5d75c-4fbf-4799-b71a-dbfb15c40128 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] 10.222.0.59 "GET /compute/v2.1/servers/bf1fb171-af43-4eca-84ca-89661ae26efa" status: 200 len: 1266 microversion: 2.1 time: 0.152688 Jun 30 10:58:28.491545 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 609/1235] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:58:28 2022] GET /compute/v2.1/servers/bf1fb171-af43-4eca-84ca-89661ae26efa => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:58:29.507530 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-c8bfb81b-eeb2-4028-a738-92d19bf073ca tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:58:29.508147 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-c8bfb81b-eeb2-4028-a738-92d19bf073ca tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] [instance: bf1fb171-af43-4eca-84ca-89661ae26efa] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:58:29.514777 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c8bfb81b-eeb2-4028-a738-92d19bf073ca tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:58:29.516379 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c8bfb81b-eeb2-4028-a738-92d19bf073ca tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:58:29.517187 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c8bfb81b-eeb2-4028-a738-92d19bf073ca tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:58:29.517627 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c8bfb81b-eeb2-4028-a738-92d19bf073ca tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:58:29.647346 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-c8bfb81b-eeb2-4028-a738-92d19bf073ca tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cb785bf7de43e7827371820617997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0e9dab1a604c38a20588ca05dae79c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:58:29.654921 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-c8bfb81b-eeb2-4028-a738-92d19bf073ca tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] 10.222.0.59 "GET /compute/v2.1/servers/bf1fb171-af43-4eca-84ca-89661ae26efa" status: 200 len: 1266 microversion: 2.1 time: 0.151330 Jun 30 10:58:29.655479 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 627/1236] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:58:29 2022] GET /compute/v2.1/servers/bf1fb171-af43-4eca-84ca-89661ae26efa => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:58:30.672316 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-b6faeb41-6d30-4f83-bf6a-f0e8d987e7e0 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:58:30.672964 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-b6faeb41-6d30-4f83-bf6a-f0e8d987e7e0 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] [instance: bf1fb171-af43-4eca-84ca-89661ae26efa] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:58:30.679437 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-b6faeb41-6d30-4f83-bf6a-f0e8d987e7e0 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:58:30.679888 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-b6faeb41-6d30-4f83-bf6a-f0e8d987e7e0 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:58:30.680688 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-b6faeb41-6d30-4f83-bf6a-f0e8d987e7e0 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:58:30.681127 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-b6faeb41-6d30-4f83-bf6a-f0e8d987e7e0 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:58:30.809907 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-b6faeb41-6d30-4f83-bf6a-f0e8d987e7e0 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cb785bf7de43e7827371820617997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0e9dab1a604c38a20588ca05dae79c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:58:30.817294 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-b6faeb41-6d30-4f83-bf6a-f0e8d987e7e0 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] 10.222.0.59 "GET /compute/v2.1/servers/bf1fb171-af43-4eca-84ca-89661ae26efa" status: 200 len: 1266 microversion: 2.1 time: 0.149635 Jun 30 10:58:30.817858 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 610/1237] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:58:30 2022] GET /compute/v2.1/servers/bf1fb171-af43-4eca-84ca-89661ae26efa => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:58:31.595737 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [req-b0a202d5-246d-4e7f-82c3-a32d812f5475 req-0b8ad717-05d1-4bdd-901b-dd3264615bc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf1fb171-af43-4eca-84ca-89661ae26efa", "name": "network-vif-plugged", "status": "completed", "tag": "118c8c6d-5238-44e6-9e33-1182fb60a562"}]} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:58:31.604289 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-b0a202d5-246d-4e7f-82c3-a32d812f5475 req-0b8ad717-05d1-4bdd-901b-dd3264615bc8 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:58:31.604776 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-b0a202d5-246d-4e7f-82c3-a32d812f5475 req-0b8ad717-05d1-4bdd-901b-dd3264615bc8 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:58:31.618616 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.compute.server_external_events [req-b0a202d5-246d-4e7f-82c3-a32d812f5475 req-0b8ad717-05d1-4bdd-901b-dd3264615bc8 service nova] Creating event network-vif-plugged:118c8c6d-5238-44e6-9e33-1182fb60a562 for instance bf1fb171-af43-4eca-84ca-89661ae26efa on hv-cinder-82282 Jun 30 10:58:31.623538 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [req-b0a202d5-246d-4e7f-82c3-a32d812f5475 req-0b8ad717-05d1-4bdd-901b-dd3264615bc8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094649 Jun 30 10:58:31.624359 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 628/1238] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:58:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:58:31.834022 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-abdab421-9bfc-4740-84bd-d0dbcde2e43d tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:58:31.834658 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-abdab421-9bfc-4740-84bd-d0dbcde2e43d tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] [instance: bf1fb171-af43-4eca-84ca-89661ae26efa] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:58:31.841303 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-abdab421-9bfc-4740-84bd-d0dbcde2e43d tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:58:31.841752 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-abdab421-9bfc-4740-84bd-d0dbcde2e43d tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:58:31.842516 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-abdab421-9bfc-4740-84bd-d0dbcde2e43d tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:58:31.842952 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-abdab421-9bfc-4740-84bd-d0dbcde2e43d tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:58:31.973311 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-abdab421-9bfc-4740-84bd-d0dbcde2e43d tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cb785bf7de43e7827371820617997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0e9dab1a604c38a20588ca05dae79c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:58:31.980644 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-abdab421-9bfc-4740-84bd-d0dbcde2e43d tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] 10.222.0.59 "GET /compute/v2.1/servers/bf1fb171-af43-4eca-84ca-89661ae26efa" status: 200 len: 1266 microversion: 2.1 time: 0.150617 Jun 30 10:58:31.981207 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 611/1239] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:58:31 2022] GET /compute/v2.1/servers/bf1fb171-af43-4eca-84ca-89661ae26efa => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:58:32.848554 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 10:58:32.849158 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Thu Jun 30 10:58:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 10:58:32.998815 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-40d59928-d0b2-4baa-9ee5-03e27a8ace0c tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:58:32.999551 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-40d59928-d0b2-4baa-9ee5-03e27a8ace0c tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] [instance: bf1fb171-af43-4eca-84ca-89661ae26efa] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:58:33.006282 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-40d59928-d0b2-4baa-9ee5-03e27a8ace0c tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:58:33.006732 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-40d59928-d0b2-4baa-9ee5-03e27a8ace0c tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:58:33.007494 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-40d59928-d0b2-4baa-9ee5-03e27a8ace0c tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:58:33.007938 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-40d59928-d0b2-4baa-9ee5-03e27a8ace0c tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:58:33.142856 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-40d59928-d0b2-4baa-9ee5-03e27a8ace0c tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cb785bf7de43e7827371820617997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0e9dab1a604c38a20588ca05dae79c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:58:33.150197 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-40d59928-d0b2-4baa-9ee5-03e27a8ace0c tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] 10.222.0.59 "GET /compute/v2.1/servers/bf1fb171-af43-4eca-84ca-89661ae26efa" status: 200 len: 1266 microversion: 2.1 time: 0.155720 Jun 30 10:58:33.150771 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 629/1240] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:58:32 2022] GET /compute/v2.1/servers/bf1fb171-af43-4eca-84ca-89661ae26efa => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:58:34.168163 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-6eaf62d1-0478-45cb-982e-afc49648d711 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:58:34.168787 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-6eaf62d1-0478-45cb-982e-afc49648d711 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] [instance: bf1fb171-af43-4eca-84ca-89661ae26efa] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:58:34.176419 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6eaf62d1-0478-45cb-982e-afc49648d711 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:58:34.176970 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6eaf62d1-0478-45cb-982e-afc49648d711 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:58:34.177742 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6eaf62d1-0478-45cb-982e-afc49648d711 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:58:34.178229 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6eaf62d1-0478-45cb-982e-afc49648d711 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:58:34.305982 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-6eaf62d1-0478-45cb-982e-afc49648d711 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cb785bf7de43e7827371820617997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0e9dab1a604c38a20588ca05dae79c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:58:34.313452 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-6eaf62d1-0478-45cb-982e-afc49648d711 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] 10.222.0.59 "GET /compute/v2.1/servers/bf1fb171-af43-4eca-84ca-89661ae26efa" status: 200 len: 1454 microversion: 2.1 time: 0.149484 Jun 30 10:58:34.314015 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 612/1241] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:58:34 2022] GET /compute/v2.1/servers/bf1fb171-af43-4eca-84ca-89661ae26efa => generated 1454 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:58:34.329022 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-6068d1af-a8e6-4150-baa1-18527da187f3 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:58:34.329636 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-6068d1af-a8e6-4150-baa1-18527da187f3 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] [instance: bf1fb171-af43-4eca-84ca-89661ae26efa] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:58:34.336047 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-6068d1af-a8e6-4150-baa1-18527da187f3 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:58:34.336496 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-6068d1af-a8e6-4150-baa1-18527da187f3 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:58:34.337288 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-6068d1af-a8e6-4150-baa1-18527da187f3 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:58:34.337726 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-6068d1af-a8e6-4150-baa1-18527da187f3 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:58:34.467265 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-6068d1af-a8e6-4150-baa1-18527da187f3 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cb785bf7de43e7827371820617997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0e9dab1a604c38a20588ca05dae79c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:58:34.475238 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-6068d1af-a8e6-4150-baa1-18527da187f3 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] 10.222.0.59 "GET /compute/v2.1/servers/bf1fb171-af43-4eca-84ca-89661ae26efa" status: 200 len: 1454 microversion: 2.1 time: 0.150020 Jun 30 10:58:34.475798 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 630/1242] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 10:58:34 2022] GET /compute/v2.1/servers/bf1fb171-af43-4eca-84ca-89661ae26efa => generated 1454 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:58:36.330457 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [req-8e436b3e-8220-413b-b178-67823060ddea req-2dca20f5-ea26-4977-8851-0775a9d48af4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf1fb171-af43-4eca-84ca-89661ae26efa", "tag": "118c8c6d-5238-44e6-9e33-1182fb60a562"}]} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:58:36.338320 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-8e436b3e-8220-413b-b178-67823060ddea req-2dca20f5-ea26-4977-8851-0775a9d48af4 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:58:36.338763 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-8e436b3e-8220-413b-b178-67823060ddea req-2dca20f5-ea26-4977-8851-0775a9d48af4 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:58:36.350110 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.compute.server_external_events [req-8e436b3e-8220-413b-b178-67823060ddea req-2dca20f5-ea26-4977-8851-0775a9d48af4 service nova] Creating event network-changed:118c8c6d-5238-44e6-9e33-1182fb60a562 for instance bf1fb171-af43-4eca-84ca-89661ae26efa on hv-cinder-82282 Jun 30 10:58:36.355069 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [req-8e436b3e-8220-413b-b178-67823060ddea req-2dca20f5-ea26-4977-8851-0775a9d48af4 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083608 Jun 30 10:58:36.355739 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 613/1243] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 10:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 11:00:14.544341 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 11:00:14.545637 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Thu Jun 30 11:00:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 11:00:17.062144 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 11:00:17.062744 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Thu Jun 30 11:00:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 11:00:51.696144 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR oslo.messaging._drivers.impl_rabbit [-] [25aec510-371a-4945-b64f-dffd1b886ba0] AMQP server on 10.222.0.59:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 30 11:00:51.696979 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 11:00:51.697712 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_cell1:SELECT=48 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 11:00:51.701970 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-4f6a931a-fa6c-4207-a5c1-1a130956f104 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 11:00:51.703126 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-4f6a931a-fa6c-4207-a5c1-1a130956f104 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] [instance: bf1fb171-af43-4eca-84ca-89661ae26efa] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 11:00:51.710433 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-4f6a931a-fa6c-4207-a5c1-1a130956f104 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:00:51.710882 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-4f6a931a-fa6c-4207-a5c1-1a130956f104 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:00:51.711647 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-4f6a931a-fa6c-4207-a5c1-1a130956f104 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:00:51.712086 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-4f6a931a-fa6c-4207-a5c1-1a130956f104 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:00:51.736719 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-4f6a931a-fa6c-4207-a5c1-1a130956f104 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] [instance: bf1fb171-af43-4eca-84ca-89661ae26efa] Going to try to terminate instance {{(pid=124203) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 11:00:51.810152 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-4f6a931a-fa6c-4207-a5c1-1a130956f104 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] 10.222.0.59 "DELETE /compute/v2.1/servers/bf1fb171-af43-4eca-84ca-89661ae26efa" status: 204 len: 0 microversion: 2.1 time: 0.115532 Jun 30 11:00:51.810813 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 631/1244] 10.222.0.59 () {58 vars in 1238 bytes} [Thu Jun 30 11:00:51 2022] DELETE /compute/v2.1/servers/bf1fb171-af43-4eca-84ca-89661ae26efa => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 11:00:51.817830 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f6b7188a-ec1e-4806-a603-a608d9b02a0b] AMQP server on 10.222.0.59:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jun 30 11:00:51.818427 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_api:SELECT=22 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 11:00:51.819223 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_cell1:SELECT=50 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 11:00:51.823838 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-92b1999b-147d-4e51-a71c-3dbef53d4a4d tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 11:00:51.824544 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-92b1999b-147d-4e51-a71c-3dbef53d4a4d tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] [instance: bf1fb171-af43-4eca-84ca-89661ae26efa] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 11:00:51.832029 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-92b1999b-147d-4e51-a71c-3dbef53d4a4d tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:00:51.832467 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-92b1999b-147d-4e51-a71c-3dbef53d4a4d tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:00:51.833246 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-92b1999b-147d-4e51-a71c-3dbef53d4a4d tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:00:51.833675 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-92b1999b-147d-4e51-a71c-3dbef53d4a4d tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:00:52.018361 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-92b1999b-147d-4e51-a71c-3dbef53d4a4d tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cb785bf7de43e7827371820617997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0e9dab1a604c38a20588ca05dae79c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 11:00:52.025847 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-92b1999b-147d-4e51-a71c-3dbef53d4a4d tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] 10.222.0.59 "GET /compute/v2.1/servers/bf1fb171-af43-4eca-84ca-89661ae26efa" status: 200 len: 1579 microversion: 2.1 time: 0.209759 Jun 30 11:00:52.026410 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 614/1245] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 11:00:51 2022] GET /compute/v2.1/servers/bf1fb171-af43-4eca-84ca-89661ae26efa => generated 1579 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 11:00:53.043476 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-73abca9f-7b33-43c8-bc19-f2975f177650 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 11:00:53.044195 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-73abca9f-7b33-43c8-bc19-f2975f177650 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] [instance: bf1fb171-af43-4eca-84ca-89661ae26efa] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 11:00:53.051990 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-73abca9f-7b33-43c8-bc19-f2975f177650 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:00:53.052432 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-73abca9f-7b33-43c8-bc19-f2975f177650 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:00:53.053207 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-73abca9f-7b33-43c8-bc19-f2975f177650 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:00:53.053637 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-73abca9f-7b33-43c8-bc19-f2975f177650 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:00:53.059684 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO oslo.messaging._drivers.impl_rabbit [-] [25aec510-371a-4945-b64f-dffd1b886ba0] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 58452. Jun 30 11:00:53.232673 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-73abca9f-7b33-43c8-bc19-f2975f177650 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cb785bf7de43e7827371820617997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0e9dab1a604c38a20588ca05dae79c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 11:00:53.241050 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-73abca9f-7b33-43c8-bc19-f2975f177650 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] 10.222.0.59 "GET /compute/v2.1/servers/bf1fb171-af43-4eca-84ca-89661ae26efa" status: 200 len: 1579 microversion: 2.1 time: 0.201504 Jun 30 11:00:53.241618 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 632/1246] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 11:00:53 2022] GET /compute/v2.1/servers/bf1fb171-af43-4eca-84ca-89661ae26efa => generated 1579 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 11:00:54.235950 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [req-e00b0789-57c1-4962-9732-d4bfd5f2c5a8 req-e4081b56-3c63-4ccf-91e2-544ff80128a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf1fb171-af43-4eca-84ca-89661ae26efa", "name": "network-vif-deleted", "tag": "118c8c6d-5238-44e6-9e33-1182fb60a562"}]} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 11:00:54.252385 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-e00b0789-57c1-4962-9732-d4bfd5f2c5a8 req-e4081b56-3c63-4ccf-91e2-544ff80128a0 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:00:54.256363 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-e00b0789-57c1-4962-9732-d4bfd5f2c5a8 req-e4081b56-3c63-4ccf-91e2-544ff80128a0 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:00:54.271278 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.compute.server_external_events [req-e00b0789-57c1-4962-9732-d4bfd5f2c5a8 req-e4081b56-3c63-4ccf-91e2-544ff80128a0 service nova] Creating event network-vif-deleted:118c8c6d-5238-44e6-9e33-1182fb60a562 for instance bf1fb171-af43-4eca-84ca-89661ae26efa on hv-cinder-82282 Jun 30 11:00:54.273526 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-c8fd2c95-4d1a-449b-8e8e-c4245ca3ac62 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 11:00:54.276900 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [req-e00b0789-57c1-4962-9732-d4bfd5f2c5a8 req-e4081b56-3c63-4ccf-91e2-544ff80128a0 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044535 Jun 30 11:00:54.277795 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 615/1247] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 11:00:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 11:00:54.277946 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-c8fd2c95-4d1a-449b-8e8e-c4245ca3ac62 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] [instance: bf1fb171-af43-4eca-84ca-89661ae26efa] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 11:00:54.286707 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c8fd2c95-4d1a-449b-8e8e-c4245ca3ac62 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:00:54.287328 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c8fd2c95-4d1a-449b-8e8e-c4245ca3ac62 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:00:54.288177 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c8fd2c95-4d1a-449b-8e8e-c4245ca3ac62 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:00:54.289147 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-c8fd2c95-4d1a-449b-8e8e-c4245ca3ac62 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:00:54.363480 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-c8fd2c95-4d1a-449b-8e8e-c4245ca3ac62 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cb785bf7de43e7827371820617997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0e9dab1a604c38a20588ca05dae79c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 11:00:54.372623 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-c8fd2c95-4d1a-449b-8e8e-c4245ca3ac62 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] 10.222.0.59 "GET /compute/v2.1/servers/bf1fb171-af43-4eca-84ca-89661ae26efa" status: 200 len: 1225 microversion: 2.1 time: 0.118429 Jun 30 11:00:54.373530 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 633/1248] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 11:00:54 2022] GET /compute/v2.1/servers/bf1fb171-af43-4eca-84ca-89661ae26efa => generated 1225 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 11:00:55.386995 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO oslo.messaging._drivers.impl_rabbit [-] [f6b7188a-ec1e-4806-a603-a608d9b02a0b] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 58458. Jun 30 11:00:55.390967 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-ab338a91-5be0-4c97-9334-90d4e2cdbdbc tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 11:00:55.391662 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-ab338a91-5be0-4c97-9334-90d4e2cdbdbc tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] [instance: bf1fb171-af43-4eca-84ca-89661ae26efa] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 11:00:55.397934 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ab338a91-5be0-4c97-9334-90d4e2cdbdbc tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:00:55.398384 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ab338a91-5be0-4c97-9334-90d4e2cdbdbc tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:00:55.399151 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ab338a91-5be0-4c97-9334-90d4e2cdbdbc tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:00:55.399589 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ab338a91-5be0-4c97-9334-90d4e2cdbdbc tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:00:55.414644 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.wsgi [None req-ab338a91-5be0-4c97-9334-90d4e2cdbdbc tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] HTTP exception thrown: Instance bf1fb171-af43-4eca-84ca-89661ae26efa could not be found. Jun 30 11:00:55.416234 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-ab338a91-5be0-4c97-9334-90d4e2cdbdbc tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Request method failure captured: Jun 30 11:00:55.416234 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: request: GET /compute/v2.1/servers/bf1fb171-af43-4eca-84ca-89661ae26efa HTTP/1.1 Jun 30 11:00:55.416234 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Accept: application/json Jun 30 11:00:55.416234 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Accept-Encoding: identity Jun 30 11:00:55.416234 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Connection: close Jun 30 11:00:55.416234 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Content-Length: 0 Jun 30 11:00:55.416234 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Content-Type: application/json Jun 30 11:00:55.416234 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Host: 10.222.0.59 Jun 30 11:00:55.416234 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Openstack-System-Scope: None Jun 30 11:00:55.416234 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: User-Agent: python-urllib3/1.26.9 Jun 30 11:00:55.416234 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Auth-Token: gAAAAABivYGrLve2IUh4L8jW8mhZoRjMEZxnRQxLSjSEdkCAqgqw5gWtKoYCqHRatqTQNg2ay44u7t9OZ_y1NASaicjP-oZ8N5-5g9LoA5SUINPqYX574pGxbHNUS4r4kOERVrLzrGKrFM-g1LLHEs017ETww0gs8gr_Q0upq_FaGvjmrXLZM1w Jun 30 11:00:55.416234 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Domain-Id: None Jun 30 11:00:55.416234 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Domain-Name: None Jun 30 11:00:55.416234 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Identity-Status: Confirmed Jun 30 11:00:55.416234 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Is-Admin-Project: True Jun 30 11:00:55.416234 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Domain-Id: default Jun 30 11:00:55.416234 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Domain-Name: Default Jun 30 11:00:55.416234 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Id: 5c0e9dab1a604c38a20588ca05dae79c Jun 30 11:00:55.416234 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Name: tempest-TestVolumeBootPattern-911516623 Jun 30 11:00:55.416234 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Role: member,reader Jun 30 11:00:55.416234 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Roles: member,reader Jun 30 11:00:55.418205 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5c0e9dab1a604c38a20588ca05dae79c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5c0e9dab1a604c38a20588ca05dae79c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5c0e9dab1a604c38a20588ca05dae79c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5c0e9dab1a604c38a20588ca05dae79c"}]}] Jun 30 11:00:55.418205 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant: tempest-TestVolumeBootPattern-911516623 Jun 30 11:00:55.418205 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant-Id: 5c0e9dab1a604c38a20588ca05dae79c Jun 30 11:00:55.418205 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant-Name: tempest-TestVolumeBootPattern-911516623 Jun 30 11:00:55.418205 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User: tempest-TestVolumeBootPattern-911516623-project Jun 30 11:00:55.418205 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Domain-Id: default Jun 30 11:00:55.418205 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Domain-Name: Default Jun 30 11:00:55.418205 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Id: 30cb785bf7de43e7827371820617997a Jun 30 11:00:55.418205 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Name: tempest-TestVolumeBootPattern-911516623-project Jun 30 11:00:55.418205 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: method: > Jun 30 11:00:55.418205 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: exception: Instance bf1fb171-af43-4eca-84ca-89661ae26efa could not be found. Jun 30 11:00:55.418205 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: action_args: {'id': 'bf1fb171-af43-4eca-84ca-89661ae26efa'} Jun 30 11:00:55.419281 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 11:00:55.419281 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 11:00:55.419281 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 11:00:55.419281 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 11:00:55.419281 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 11:00:55.419281 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 11:00:55.419281 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 11:00:55.419281 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 11:00:55.419281 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 11:00:55.419281 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 11:00:55.419281 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf1fb171-af43-4eca-84ca-89661ae26efa could not be found. Jun 30 11:00:55.419281 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 11:00:55.419281 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 11:00:55.419281 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 11:00:55.419281 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 11:00:55.419281 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 11:00:55.419281 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 11:00:55.419281 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 11:00:55.419281 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 11:00:55.419281 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 11:00:55.421522 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 11:00:55.421522 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 11:00:55.421522 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 11:00:55.421522 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 11:00:55.421522 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 11:00:55.421522 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 11:00:55.421522 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 11:00:55.421522 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf1fb171-af43-4eca-84ca-89661ae26efa could not be found. Jun 30 11:00:55.421522 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 11:00:55.421522 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 11:00:55.421522 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 11:00:55.421522 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 11:00:55.421522 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 11:00:55.421522 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 11:00:55.421522 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 11:00:55.421522 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 11:00:55.421522 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf1fb171-af43-4eca-84ca-89661ae26efa could not be found. Jun 30 11:00:55.421522 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 11:00:55.423383 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-ab338a91-5be0-4c97-9334-90d4e2cdbdbc tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Returning 404 to user: Instance bf1fb171-af43-4eca-84ca-89661ae26efa could not be found. {{(pid=124204) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 11:00:55.423383 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-ab338a91-5be0-4c97-9334-90d4e2cdbdbc tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] 10.222.0.59 "GET /compute/v2.1/servers/bf1fb171-af43-4eca-84ca-89661ae26efa" status: 404 len: 111 microversion: 2.1 time: 0.031775 Jun 30 11:00:55.423383 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 616/1249] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 11:00:55 2022] GET /compute/v2.1/servers/bf1fb171-af43-4eca-84ca-89661ae26efa => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 11:00:55.463300 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-9503c225-7a67-408a-b679-de52ee8d76a0 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1305032001", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1197647493", "security_groups": [{"name": "tempest-secgroup-smoke-1530973117"}], "block_device_mapping_v2": [{"uuid": "29f4c693-f84a-42db-a17d-6ce4949e3bb3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a07943fc-a493-40c6-8bff-70034a7afb3d"}]}} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 11:00:55.578592 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.network.neutron [None req-9503c225-7a67-408a-b679-de52ee8d76a0 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] validate_networks() for [('a07943fc-a493-40c6-8bff-70034a7afb3d', None, None, None, None, None)] {{(pid=124203) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 11:00:55.962920 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.virt.hardware [None req-9503c225-7a67-408a-b679-de52ee8d76a0 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Flavor limits 0:0:0 {{(pid=124203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 11:00:55.963350 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.virt.hardware [None req-9503c225-7a67-408a-b679-de52ee8d76a0 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Image limits 0:0:0 {{(pid=124203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 11:00:55.963836 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.virt.hardware [None req-9503c225-7a67-408a-b679-de52ee8d76a0 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Flavor pref 0:0:0 {{(pid=124203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 11:00:55.964267 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.virt.hardware [None req-9503c225-7a67-408a-b679-de52ee8d76a0 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Image pref 0:0:0 {{(pid=124203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 11:00:55.964712 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.virt.hardware [None req-9503c225-7a67-408a-b679-de52ee8d76a0 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 11:00:55.974107 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-9503c225-7a67-408a-b679-de52ee8d76a0 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:00:55.974554 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-9503c225-7a67-408a-b679-de52ee8d76a0 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:00:55.975352 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-9503c225-7a67-408a-b679-de52ee8d76a0 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:00:55.975788 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-9503c225-7a67-408a-b679-de52ee8d76a0 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:00:55.995438 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.quota [None req-9503c225-7a67-408a-b679-de52ee8d76a0 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Getting quotas for project 5c0e9dab1a604c38a20588ca05dae79c. Resources: {'instances', 'cores', 'ram'} {{(pid=124203) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 11:00:55.999452 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.quota [None req-9503c225-7a67-408a-b679-de52ee8d76a0 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Getting quotas for user 30cb785bf7de43e7827371820617997a and project 5c0e9dab1a604c38a20588ca05dae79c. Resources: {'instances', 'cores', 'ram'} {{(pid=124203) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 11:00:56.055555 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-9503c225-7a67-408a-b679-de52ee8d76a0 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Going to run 1 instances... {{(pid=124203) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 11:00:56.057671 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-9503c225-7a67-408a-b679-de52ee8d76a0 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] [instance: 37391b9e-a061-4ea4-82bb-b426a9d470d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='29f4c693-f84a-42db-a17d-6ce4949e3bb3',volume_size=None,volume_type=None)] {{(pid=124203) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 11:00:56.181181 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-9503c225-7a67-408a-b679-de52ee8d76a0 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.721675 Jun 30 11:00:56.181824 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 634/1250] 10.222.0.59 () {60 vars in 1146 bytes} [Thu Jun 30 11:00:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 11:00:56.192522 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-37c43386-9003-48aa-9c13-575b8b2dbc74 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 11:00:56.193262 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-37c43386-9003-48aa-9c13-575b8b2dbc74 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] [instance: 37391b9e-a061-4ea4-82bb-b426a9d470d2] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 11:00:56.246847 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-37c43386-9003-48aa-9c13-575b8b2dbc74 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cb785bf7de43e7827371820617997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0e9dab1a604c38a20588ca05dae79c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 11:00:56.254113 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-37c43386-9003-48aa-9c13-575b8b2dbc74 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] 10.222.0.59 "GET /compute/v2.1/servers/37391b9e-a061-4ea4-82bb-b426a9d470d2" status: 200 len: 1095 microversion: 2.1 time: 0.065584 Jun 30 11:00:56.254916 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 617/1251] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 11:00:56 2022] GET /compute/v2.1/servers/37391b9e-a061-4ea4-82bb-b426a9d470d2 => generated 1095 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 11:00:57.271573 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-00e52412-8dc9-4efa-ab74-2e00a03aa989 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 11:00:57.272354 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-00e52412-8dc9-4efa-ab74-2e00a03aa989 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] [instance: 37391b9e-a061-4ea4-82bb-b426a9d470d2] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 11:00:57.278679 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-00e52412-8dc9-4efa-ab74-2e00a03aa989 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:00:57.279127 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-00e52412-8dc9-4efa-ab74-2e00a03aa989 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:00:57.279894 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-00e52412-8dc9-4efa-ab74-2e00a03aa989 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:00:57.280328 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-00e52412-8dc9-4efa-ab74-2e00a03aa989 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:00:57.341662 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-00e52412-8dc9-4efa-ab74-2e00a03aa989 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cb785bf7de43e7827371820617997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0e9dab1a604c38a20588ca05dae79c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 11:00:57.349440 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-00e52412-8dc9-4efa-ab74-2e00a03aa989 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] 10.222.0.59 "GET /compute/v2.1/servers/37391b9e-a061-4ea4-82bb-b426a9d470d2" status: 200 len: 1211 microversion: 2.1 time: 0.082037 Jun 30 11:00:57.349936 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 635/1252] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 11:00:57 2022] GET /compute/v2.1/servers/37391b9e-a061-4ea4-82bb-b426a9d470d2 => generated 1211 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 11:00:58.367431 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-42fc181c-6ce6-47f4-a9d3-ecb6f967674b tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 11:00:58.368063 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-42fc181c-6ce6-47f4-a9d3-ecb6f967674b tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] [instance: 37391b9e-a061-4ea4-82bb-b426a9d470d2] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 11:00:58.375830 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-42fc181c-6ce6-47f4-a9d3-ecb6f967674b tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:00:58.376270 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-42fc181c-6ce6-47f4-a9d3-ecb6f967674b tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:00:58.377054 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-42fc181c-6ce6-47f4-a9d3-ecb6f967674b tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:00:58.377483 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-42fc181c-6ce6-47f4-a9d3-ecb6f967674b tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:00:58.510902 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-42fc181c-6ce6-47f4-a9d3-ecb6f967674b tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cb785bf7de43e7827371820617997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0e9dab1a604c38a20588ca05dae79c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 11:00:58.519060 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-42fc181c-6ce6-47f4-a9d3-ecb6f967674b tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] 10.222.0.59 "GET /compute/v2.1/servers/37391b9e-a061-4ea4-82bb-b426a9d470d2" status: 200 len: 1267 microversion: 2.1 time: 0.155640 Jun 30 11:00:58.529056 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 618/1253] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 11:00:58 2022] GET /compute/v2.1/servers/37391b9e-a061-4ea4-82bb-b426a9d470d2 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 11:00:58.705126 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [req-1177d2e3-6444-4351-8518-18c181ba6938 req-b041e16c-a3ae-4584-85e8-ed1b007d5d4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37391b9e-a061-4ea4-82bb-b426a9d470d2", "tag": "3821e1c5-4d78-4bd6-b133-103d75e6f296"}]} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 11:00:58.715596 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-1177d2e3-6444-4351-8518-18c181ba6938 req-b041e16c-a3ae-4584-85e8-ed1b007d5d4d service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:00:58.717933 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-1177d2e3-6444-4351-8518-18c181ba6938 req-b041e16c-a3ae-4584-85e8-ed1b007d5d4d service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:00:58.735848 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.compute.server_external_events [req-1177d2e3-6444-4351-8518-18c181ba6938 req-b041e16c-a3ae-4584-85e8-ed1b007d5d4d service nova] Creating event network-changed:3821e1c5-4d78-4bd6-b133-103d75e6f296 for instance 37391b9e-a061-4ea4-82bb-b426a9d470d2 on hv-cinder-82282 Jun 30 11:00:58.741997 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [req-1177d2e3-6444-4351-8518-18c181ba6938 req-b041e16c-a3ae-4584-85e8-ed1b007d5d4d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045590 Jun 30 11:00:58.743124 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 636/1254] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 11:00:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 11:00:59.536710 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-edb8bf3b-2202-4a84-a8a9-396629e21e97 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 11:00:59.537321 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-edb8bf3b-2202-4a84-a8a9-396629e21e97 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] [instance: 37391b9e-a061-4ea4-82bb-b426a9d470d2] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 11:00:59.543788 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-edb8bf3b-2202-4a84-a8a9-396629e21e97 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:00:59.544229 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-edb8bf3b-2202-4a84-a8a9-396629e21e97 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:00:59.545007 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-edb8bf3b-2202-4a84-a8a9-396629e21e97 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:00:59.545448 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-edb8bf3b-2202-4a84-a8a9-396629e21e97 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:00:59.676722 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-edb8bf3b-2202-4a84-a8a9-396629e21e97 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cb785bf7de43e7827371820617997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0e9dab1a604c38a20588ca05dae79c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 11:00:59.684162 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-edb8bf3b-2202-4a84-a8a9-396629e21e97 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] 10.222.0.59 "GET /compute/v2.1/servers/37391b9e-a061-4ea4-82bb-b426a9d470d2" status: 200 len: 1267 microversion: 2.1 time: 0.151341 Jun 30 11:00:59.684755 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 619/1255] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 11:00:59 2022] GET /compute/v2.1/servers/37391b9e-a061-4ea4-82bb-b426a9d470d2 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 11:01:00.701131 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-ffd76aca-1662-42ae-97bb-a196a563daf4 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 11:01:00.701831 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-ffd76aca-1662-42ae-97bb-a196a563daf4 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] [instance: 37391b9e-a061-4ea4-82bb-b426a9d470d2] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 11:01:00.707975 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ffd76aca-1662-42ae-97bb-a196a563daf4 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:01:00.708425 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ffd76aca-1662-42ae-97bb-a196a563daf4 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:01:00.709207 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ffd76aca-1662-42ae-97bb-a196a563daf4 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:01:00.709650 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ffd76aca-1662-42ae-97bb-a196a563daf4 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:01:00.836987 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-ffd76aca-1662-42ae-97bb-a196a563daf4 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cb785bf7de43e7827371820617997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0e9dab1a604c38a20588ca05dae79c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 11:01:00.844850 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-ffd76aca-1662-42ae-97bb-a196a563daf4 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] 10.222.0.59 "GET /compute/v2.1/servers/37391b9e-a061-4ea4-82bb-b426a9d470d2" status: 200 len: 1267 microversion: 2.1 time: 0.148441 Jun 30 11:01:00.845405 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 637/1256] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 11:01:00 2022] GET /compute/v2.1/servers/37391b9e-a061-4ea4-82bb-b426a9d470d2 => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 11:01:01.861891 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-1e80f593-a24e-40b4-94b0-1ff51417f4d0 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 11:01:01.862533 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-1e80f593-a24e-40b4-94b0-1ff51417f4d0 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] [instance: 37391b9e-a061-4ea4-82bb-b426a9d470d2] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 11:01:01.869395 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1e80f593-a24e-40b4-94b0-1ff51417f4d0 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:01:01.869721 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1e80f593-a24e-40b4-94b0-1ff51417f4d0 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:01:01.870471 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1e80f593-a24e-40b4-94b0-1ff51417f4d0 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:01:01.870898 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1e80f593-a24e-40b4-94b0-1ff51417f4d0 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:01:02.002184 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-1e80f593-a24e-40b4-94b0-1ff51417f4d0 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cb785bf7de43e7827371820617997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0e9dab1a604c38a20588ca05dae79c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 11:01:02.009749 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-1e80f593-a24e-40b4-94b0-1ff51417f4d0 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] 10.222.0.59 "GET /compute/v2.1/servers/37391b9e-a061-4ea4-82bb-b426a9d470d2" status: 200 len: 1267 microversion: 2.1 time: 0.152273 Jun 30 11:01:02.010310 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 620/1257] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 11:01:01 2022] GET /compute/v2.1/servers/37391b9e-a061-4ea4-82bb-b426a9d470d2 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 11:01:03.026801 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-a96371ae-7e4c-471f-8abc-99ffcb46b258 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 11:01:03.027346 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-a96371ae-7e4c-471f-8abc-99ffcb46b258 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] [instance: 37391b9e-a061-4ea4-82bb-b426a9d470d2] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 11:01:03.033888 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a96371ae-7e4c-471f-8abc-99ffcb46b258 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:01:03.034376 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a96371ae-7e4c-471f-8abc-99ffcb46b258 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:01:03.035142 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a96371ae-7e4c-471f-8abc-99ffcb46b258 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:01:03.035575 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a96371ae-7e4c-471f-8abc-99ffcb46b258 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:01:03.163747 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-a96371ae-7e4c-471f-8abc-99ffcb46b258 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cb785bf7de43e7827371820617997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0e9dab1a604c38a20588ca05dae79c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 11:01:03.171166 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-a96371ae-7e4c-471f-8abc-99ffcb46b258 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] 10.222.0.59 "GET /compute/v2.1/servers/37391b9e-a061-4ea4-82bb-b426a9d470d2" status: 200 len: 1267 microversion: 2.1 time: 0.148443 Jun 30 11:01:03.171730 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 638/1258] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 11:01:03 2022] GET /compute/v2.1/servers/37391b9e-a061-4ea4-82bb-b426a9d470d2 => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 11:01:04.188355 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-01ccbdce-deea-4821-a057-870bf67a79a5 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 11:01:04.189003 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-01ccbdce-deea-4821-a057-870bf67a79a5 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] [instance: 37391b9e-a061-4ea4-82bb-b426a9d470d2] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 11:01:04.195543 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-01ccbdce-deea-4821-a057-870bf67a79a5 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:01:04.195990 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-01ccbdce-deea-4821-a057-870bf67a79a5 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:01:04.196787 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-01ccbdce-deea-4821-a057-870bf67a79a5 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:01:04.197230 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-01ccbdce-deea-4821-a057-870bf67a79a5 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:01:04.327116 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-01ccbdce-deea-4821-a057-870bf67a79a5 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cb785bf7de43e7827371820617997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0e9dab1a604c38a20588ca05dae79c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 11:01:04.334976 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-01ccbdce-deea-4821-a057-870bf67a79a5 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] 10.222.0.59 "GET /compute/v2.1/servers/37391b9e-a061-4ea4-82bb-b426a9d470d2" status: 200 len: 1267 microversion: 2.1 time: 0.150979 Jun 30 11:01:04.335546 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 621/1259] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 11:01:04 2022] GET /compute/v2.1/servers/37391b9e-a061-4ea4-82bb-b426a9d470d2 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 11:01:05.351765 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-8790e58c-3048-4546-a8bf-8c496934c995 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 11:01:05.352385 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-8790e58c-3048-4546-a8bf-8c496934c995 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] [instance: 37391b9e-a061-4ea4-82bb-b426a9d470d2] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 11:01:05.360603 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-8790e58c-3048-4546-a8bf-8c496934c995 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:01:05.361610 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-8790e58c-3048-4546-a8bf-8c496934c995 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:01:05.362376 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-8790e58c-3048-4546-a8bf-8c496934c995 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:01:05.362813 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-8790e58c-3048-4546-a8bf-8c496934c995 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:01:05.490079 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-8790e58c-3048-4546-a8bf-8c496934c995 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cb785bf7de43e7827371820617997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0e9dab1a604c38a20588ca05dae79c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 11:01:05.497935 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-8790e58c-3048-4546-a8bf-8c496934c995 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] 10.222.0.59 "GET /compute/v2.1/servers/37391b9e-a061-4ea4-82bb-b426a9d470d2" status: 200 len: 1267 microversion: 2.1 time: 0.150049 Jun 30 11:01:05.498490 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 639/1260] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 11:01:05 2022] GET /compute/v2.1/servers/37391b9e-a061-4ea4-82bb-b426a9d470d2 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 11:01:06.514699 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-f7db2b4b-1122-4314-9adc-cb8e1b76e001 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 11:01:06.515251 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-f7db2b4b-1122-4314-9adc-cb8e1b76e001 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] [instance: 37391b9e-a061-4ea4-82bb-b426a9d470d2] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 11:01:06.517823 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_cell0:SELECT=2 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 11:01:06.523857 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f7db2b4b-1122-4314-9adc-cb8e1b76e001 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:01:06.524300 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f7db2b4b-1122-4314-9adc-cb8e1b76e001 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:01:06.525164 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f7db2b4b-1122-4314-9adc-cb8e1b76e001 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:01:06.525770 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f7db2b4b-1122-4314-9adc-cb8e1b76e001 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:01:06.653323 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-f7db2b4b-1122-4314-9adc-cb8e1b76e001 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cb785bf7de43e7827371820617997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0e9dab1a604c38a20588ca05dae79c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 11:01:06.661209 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-f7db2b4b-1122-4314-9adc-cb8e1b76e001 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] 10.222.0.59 "GET /compute/v2.1/servers/37391b9e-a061-4ea4-82bb-b426a9d470d2" status: 200 len: 1267 microversion: 2.1 time: 0.150654 Jun 30 11:01:06.661778 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 622/1261] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 11:01:06 2022] GET /compute/v2.1/servers/37391b9e-a061-4ea4-82bb-b426a9d470d2 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 11:01:07.677515 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-4b5f2bd9-aa90-4a4f-9f35-b843595ef8be tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 11:01:07.678117 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-4b5f2bd9-aa90-4a4f-9f35-b843595ef8be tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] [instance: 37391b9e-a061-4ea4-82bb-b426a9d470d2] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 11:01:07.680034 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_cell0:SELECT=2 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 11:01:07.680849 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_cell0:SELECT=6 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 11:01:07.686803 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-4b5f2bd9-aa90-4a4f-9f35-b843595ef8be tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:01:07.687247 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-4b5f2bd9-aa90-4a4f-9f35-b843595ef8be tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:01:07.688011 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-4b5f2bd9-aa90-4a4f-9f35-b843595ef8be tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:01:07.688448 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-4b5f2bd9-aa90-4a4f-9f35-b843595ef8be tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:01:07.821607 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-4b5f2bd9-aa90-4a4f-9f35-b843595ef8be tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cb785bf7de43e7827371820617997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0e9dab1a604c38a20588ca05dae79c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 11:01:07.829135 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-4b5f2bd9-aa90-4a4f-9f35-b843595ef8be tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] 10.222.0.59 "GET /compute/v2.1/servers/37391b9e-a061-4ea4-82bb-b426a9d470d2" status: 200 len: 1267 microversion: 2.1 time: 0.156215 Jun 30 11:01:07.829701 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 640/1262] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 11:01:07 2022] GET /compute/v2.1/servers/37391b9e-a061-4ea4-82bb-b426a9d470d2 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 11:01:08.846876 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-38a00237-91cd-4b8b-a264-b010e8f6be39 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 11:01:08.847450 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-38a00237-91cd-4b8b-a264-b010e8f6be39 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] [instance: 37391b9e-a061-4ea4-82bb-b426a9d470d2] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 11:01:08.853876 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-38a00237-91cd-4b8b-a264-b010e8f6be39 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:01:08.854324 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-38a00237-91cd-4b8b-a264-b010e8f6be39 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:01:08.855087 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-38a00237-91cd-4b8b-a264-b010e8f6be39 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:01:08.855524 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-38a00237-91cd-4b8b-a264-b010e8f6be39 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:01:08.984222 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-38a00237-91cd-4b8b-a264-b010e8f6be39 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cb785bf7de43e7827371820617997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0e9dab1a604c38a20588ca05dae79c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 11:01:08.991983 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-38a00237-91cd-4b8b-a264-b010e8f6be39 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] 10.222.0.59 "GET /compute/v2.1/servers/37391b9e-a061-4ea4-82bb-b426a9d470d2" status: 200 len: 1267 microversion: 2.1 time: 0.149750 Jun 30 11:01:08.992565 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 623/1263] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 11:01:08 2022] GET /compute/v2.1/servers/37391b9e-a061-4ea4-82bb-b426a9d470d2 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 11:01:10.008626 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-1ac1936b-d1df-4a14-946b-69681dd46df5 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 11:01:10.009417 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-1ac1936b-d1df-4a14-946b-69681dd46df5 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] [instance: 37391b9e-a061-4ea4-82bb-b426a9d470d2] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 11:01:10.015904 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-1ac1936b-d1df-4a14-946b-69681dd46df5 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:01:10.016346 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-1ac1936b-d1df-4a14-946b-69681dd46df5 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:01:10.017225 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-1ac1936b-d1df-4a14-946b-69681dd46df5 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:01:10.017660 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-1ac1936b-d1df-4a14-946b-69681dd46df5 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:01:10.154079 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-1ac1936b-d1df-4a14-946b-69681dd46df5 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cb785bf7de43e7827371820617997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0e9dab1a604c38a20588ca05dae79c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 11:01:10.162238 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-1ac1936b-d1df-4a14-946b-69681dd46df5 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] 10.222.0.59 "GET /compute/v2.1/servers/37391b9e-a061-4ea4-82bb-b426a9d470d2" status: 200 len: 1267 microversion: 2.1 time: 0.157511 Jun 30 11:01:10.162869 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 641/1264] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 11:01:10 2022] GET /compute/v2.1/servers/37391b9e-a061-4ea4-82bb-b426a9d470d2 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 11:01:10.230623 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [req-1d215167-4980-46b9-91be-3442fdd4c980 req-ee05ab11-cdc5-4d90-a768-89f0d894868d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37391b9e-a061-4ea4-82bb-b426a9d470d2", "name": "network-vif-plugged", "status": "completed", "tag": "3821e1c5-4d78-4bd6-b133-103d75e6f296"}]} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 11:01:10.240667 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-1d215167-4980-46b9-91be-3442fdd4c980 req-ee05ab11-cdc5-4d90-a768-89f0d894868d service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:01:10.241547 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-1d215167-4980-46b9-91be-3442fdd4c980 req-ee05ab11-cdc5-4d90-a768-89f0d894868d service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:01:10.253086 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.compute.server_external_events [req-1d215167-4980-46b9-91be-3442fdd4c980 req-ee05ab11-cdc5-4d90-a768-89f0d894868d service nova] Creating event network-vif-plugged:3821e1c5-4d78-4bd6-b133-103d75e6f296 for instance 37391b9e-a061-4ea4-82bb-b426a9d470d2 on hv-cinder-82282 Jun 30 11:01:10.260282 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [req-1d215167-4980-46b9-91be-3442fdd4c980 req-ee05ab11-cdc5-4d90-a768-89f0d894868d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032603 Jun 30 11:01:10.261007 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 624/1265] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 11:01:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 11:01:11.178858 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-75b08c60-e5ad-48d5-9358-09e7ef1bb35b tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 11:01:11.179452 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-75b08c60-e5ad-48d5-9358-09e7ef1bb35b tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] [instance: 37391b9e-a061-4ea4-82bb-b426a9d470d2] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 11:01:11.186038 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-75b08c60-e5ad-48d5-9358-09e7ef1bb35b tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:01:11.186493 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-75b08c60-e5ad-48d5-9358-09e7ef1bb35b tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:01:11.187252 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-75b08c60-e5ad-48d5-9358-09e7ef1bb35b tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:01:11.187694 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-75b08c60-e5ad-48d5-9358-09e7ef1bb35b tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:01:11.317531 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-75b08c60-e5ad-48d5-9358-09e7ef1bb35b tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cb785bf7de43e7827371820617997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0e9dab1a604c38a20588ca05dae79c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 11:01:11.324916 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-75b08c60-e5ad-48d5-9358-09e7ef1bb35b tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] 10.222.0.59 "GET /compute/v2.1/servers/37391b9e-a061-4ea4-82bb-b426a9d470d2" status: 200 len: 1267 microversion: 2.1 time: 0.149924 Jun 30 11:01:11.325477 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 642/1266] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 11:01:11 2022] GET /compute/v2.1/servers/37391b9e-a061-4ea4-82bb-b426a9d470d2 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 11:01:12.342167 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-6ad923a0-94d8-4ff7-b1df-ca1636a4b1a2 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 11:01:12.342897 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-6ad923a0-94d8-4ff7-b1df-ca1636a4b1a2 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] [instance: 37391b9e-a061-4ea4-82bb-b426a9d470d2] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 11:01:12.350301 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6ad923a0-94d8-4ff7-b1df-ca1636a4b1a2 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:01:12.350747 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6ad923a0-94d8-4ff7-b1df-ca1636a4b1a2 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:01:12.351507 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6ad923a0-94d8-4ff7-b1df-ca1636a4b1a2 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:01:12.351934 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-6ad923a0-94d8-4ff7-b1df-ca1636a4b1a2 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:01:12.481339 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-6ad923a0-94d8-4ff7-b1df-ca1636a4b1a2 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cb785bf7de43e7827371820617997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0e9dab1a604c38a20588ca05dae79c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 11:01:12.488921 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-6ad923a0-94d8-4ff7-b1df-ca1636a4b1a2 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] 10.222.0.59 "GET /compute/v2.1/servers/37391b9e-a061-4ea4-82bb-b426a9d470d2" status: 200 len: 1454 microversion: 2.1 time: 0.150960 Jun 30 11:01:12.489486 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 625/1267] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 11:01:12 2022] GET /compute/v2.1/servers/37391b9e-a061-4ea4-82bb-b426a9d470d2 => generated 1454 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 11:01:12.505712 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-8bec988c-18b5-4915-8f7f-5cd0175763ff tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 11:01:12.506322 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-8bec988c-18b5-4915-8f7f-5cd0175763ff tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] [instance: 37391b9e-a061-4ea4-82bb-b426a9d470d2] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 11:01:12.512823 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-8bec988c-18b5-4915-8f7f-5cd0175763ff tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:01:12.513220 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-8bec988c-18b5-4915-8f7f-5cd0175763ff tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:01:12.513984 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-8bec988c-18b5-4915-8f7f-5cd0175763ff tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:01:12.514422 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-8bec988c-18b5-4915-8f7f-5cd0175763ff tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:01:12.647101 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-8bec988c-18b5-4915-8f7f-5cd0175763ff tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cb785bf7de43e7827371820617997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0e9dab1a604c38a20588ca05dae79c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 11:01:12.654562 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-8bec988c-18b5-4915-8f7f-5cd0175763ff tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] 10.222.0.59 "GET /compute/v2.1/servers/37391b9e-a061-4ea4-82bb-b426a9d470d2" status: 200 len: 1454 microversion: 2.1 time: 0.152832 Jun 30 11:01:12.657700 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 643/1268] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 11:01:12 2022] GET /compute/v2.1/servers/37391b9e-a061-4ea4-82bb-b426a9d470d2 => generated 1454 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 11:01:14.391319 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [req-52dcfda3-99c4-40ee-9bcf-c71276392a17 req-edd331d0-9e49-4ca7-9e63-fb6f29fdec9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37391b9e-a061-4ea4-82bb-b426a9d470d2", "tag": "3821e1c5-4d78-4bd6-b133-103d75e6f296"}]} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 11:01:14.400366 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-52dcfda3-99c4-40ee-9bcf-c71276392a17 req-edd331d0-9e49-4ca7-9e63-fb6f29fdec9c service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:01:14.400837 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-52dcfda3-99c4-40ee-9bcf-c71276392a17 req-edd331d0-9e49-4ca7-9e63-fb6f29fdec9c service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:01:14.411707 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.compute.server_external_events [req-52dcfda3-99c4-40ee-9bcf-c71276392a17 req-edd331d0-9e49-4ca7-9e63-fb6f29fdec9c service nova] Creating event network-changed:3821e1c5-4d78-4bd6-b133-103d75e6f296 for instance 37391b9e-a061-4ea4-82bb-b426a9d470d2 on hv-cinder-82282 Jun 30 11:01:14.417227 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [req-52dcfda3-99c4-40ee-9bcf-c71276392a17 req-edd331d0-9e49-4ca7-9e63-fb6f29fdec9c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029541 Jun 30 11:01:14.418002 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 626/1269] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 11:01:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 11:01:52.857867 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 11:01:52.858632 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Thu Jun 30 11:01:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 11:03:24.872805 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 11:03:24.873547 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 11:03:24.877423 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-4f68a8f8-853b-4a38-8386-46c7a7028cb5 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1524658424", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1197647493", "security_groups": [{"name": "tempest-secgroup-smoke-1530973117"}], "block_device_mapping_v2": [{"uuid": "ed170f74-d455-4a61-b9df-6ae4fb9709aa", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a07943fc-a493-40c6-8bff-70034a7afb3d"}]}} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 11:03:24.990069 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.network.neutron [None req-4f68a8f8-853b-4a38-8386-46c7a7028cb5 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] validate_networks() for [('a07943fc-a493-40c6-8bff-70034a7afb3d', None, None, None, None, None)] {{(pid=124203) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 11:03:25.403421 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.virt.hardware [None req-4f68a8f8-853b-4a38-8386-46c7a7028cb5 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Flavor limits 0:0:0 {{(pid=124203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 11:03:25.403848 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.virt.hardware [None req-4f68a8f8-853b-4a38-8386-46c7a7028cb5 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Image limits 0:0:0 {{(pid=124203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 11:03:25.404327 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.virt.hardware [None req-4f68a8f8-853b-4a38-8386-46c7a7028cb5 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Flavor pref 0:0:0 {{(pid=124203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 11:03:25.404769 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.virt.hardware [None req-4f68a8f8-853b-4a38-8386-46c7a7028cb5 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Image pref 0:0:0 {{(pid=124203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 11:03:25.405184 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.virt.hardware [None req-4f68a8f8-853b-4a38-8386-46c7a7028cb5 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 11:03:25.413799 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-4f68a8f8-853b-4a38-8386-46c7a7028cb5 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:03:25.414253 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-4f68a8f8-853b-4a38-8386-46c7a7028cb5 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:03:25.415039 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-4f68a8f8-853b-4a38-8386-46c7a7028cb5 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:03:25.415471 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-4f68a8f8-853b-4a38-8386-46c7a7028cb5 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:03:25.433195 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.quota [None req-4f68a8f8-853b-4a38-8386-46c7a7028cb5 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Getting quotas for project 5c0e9dab1a604c38a20588ca05dae79c. Resources: {'instances', 'cores', 'ram'} {{(pid=124203) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 11:03:25.437113 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.quota [None req-4f68a8f8-853b-4a38-8386-46c7a7028cb5 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Getting quotas for user 30cb785bf7de43e7827371820617997a and project 5c0e9dab1a604c38a20588ca05dae79c. Resources: {'instances', 'cores', 'ram'} {{(pid=124203) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 11:03:25.494661 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-4f68a8f8-853b-4a38-8386-46c7a7028cb5 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Going to run 1 instances... {{(pid=124203) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 11:03:25.496871 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-4f68a8f8-853b-4a38-8386-46c7a7028cb5 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] [instance: 680585a4-099f-470f-89db-cc4694bdb54f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ed170f74-d455-4a61-b9df-6ae4fb9709aa',volume_size=None,volume_type=None)] {{(pid=124203) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 11:03:25.621006 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4f68a8f8-853b-4a38-8386-46c7a7028cb5 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] [868465c7-c1c5-48d6-a675-60fa138bb34c] AMQP server on 10.222.0.59:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 30 11:03:26.627941 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO oslo.messaging._drivers.impl_rabbit [None req-4f68a8f8-853b-4a38-8386-46c7a7028cb5 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] [868465c7-c1c5-48d6-a675-60fa138bb34c] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 58618. Jun 30 11:03:26.631611 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-4f68a8f8-853b-4a38-8386-46c7a7028cb5 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.761301 Jun 30 11:03:26.632257 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 644/1270] 10.222.0.59 () {60 vars in 1146 bytes} [Thu Jun 30 11:03:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 1762 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 11:03:26.641827 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f6b7188a-ec1e-4806-a603-a608d9b02a0b] AMQP server on 10.222.0.59:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jun 30 11:03:26.642427 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_api:SELECT=28 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 11:03:26.643164 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_cell1:SELECT=56 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 11:03:26.647802 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-be1a7c34-e83c-4951-a95f-d07e710d0701 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 11:03:26.648536 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-be1a7c34-e83c-4951-a95f-d07e710d0701 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] [instance: 680585a4-099f-470f-89db-cc4694bdb54f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 11:03:26.702146 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-be1a7c34-e83c-4951-a95f-d07e710d0701 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cb785bf7de43e7827371820617997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0e9dab1a604c38a20588ca05dae79c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 11:03:26.708794 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-be1a7c34-e83c-4951-a95f-d07e710d0701 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] 10.222.0.59 "GET /compute/v2.1/servers/680585a4-099f-470f-89db-cc4694bdb54f" status: 200 len: 1095 microversion: 2.1 time: 0.070414 Jun 30 11:03:26.709354 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 627/1271] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 11:03:26 2022] GET /compute/v2.1/servers/680585a4-099f-470f-89db-cc4694bdb54f => generated 1095 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 11:03:27.726386 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-0bb37895-f99b-45e1-8dbc-b88a6edaab49 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 11:03:27.726989 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-0bb37895-f99b-45e1-8dbc-b88a6edaab49 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] [instance: 680585a4-099f-470f-89db-cc4694bdb54f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 11:03:27.781325 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-0bb37895-f99b-45e1-8dbc-b88a6edaab49 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cb785bf7de43e7827371820617997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0e9dab1a604c38a20588ca05dae79c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 11:03:27.787998 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-0bb37895-f99b-45e1-8dbc-b88a6edaab49 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] 10.222.0.59 "GET /compute/v2.1/servers/680585a4-099f-470f-89db-cc4694bdb54f" status: 200 len: 1095 microversion: 2.1 time: 0.065898 Jun 30 11:03:27.788577 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 645/1272] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 11:03:27 2022] GET /compute/v2.1/servers/680585a4-099f-470f-89db-cc4694bdb54f => generated 1095 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 11:03:28.804900 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-9e777583-286e-42cd-83af-5ac2be6ace46 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 11:03:28.805510 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-9e777583-286e-42cd-83af-5ac2be6ace46 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] [instance: 680585a4-099f-470f-89db-cc4694bdb54f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 11:03:28.816308 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO oslo.messaging._drivers.impl_rabbit [-] [f6b7188a-ec1e-4806-a603-a608d9b02a0b] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 58638. Jun 30 11:03:28.868049 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-9e777583-286e-42cd-83af-5ac2be6ace46 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cb785bf7de43e7827371820617997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0e9dab1a604c38a20588ca05dae79c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 11:03:28.876090 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-9e777583-286e-42cd-83af-5ac2be6ace46 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] 10.222.0.59 "GET /compute/v2.1/servers/680585a4-099f-470f-89db-cc4694bdb54f" status: 200 len: 1095 microversion: 2.1 time: 0.074941 Jun 30 11:03:28.876705 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 628/1273] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 11:03:28 2022] GET /compute/v2.1/servers/680585a4-099f-470f-89db-cc4694bdb54f => generated 1095 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 11:03:29.892047 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-3eb76cb7-60c4-4bd2-8e02-8cc13026cd99 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 11:03:29.892684 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-3eb76cb7-60c4-4bd2-8e02-8cc13026cd99 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] [instance: 680585a4-099f-470f-89db-cc4694bdb54f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 11:03:29.948708 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-3eb76cb7-60c4-4bd2-8e02-8cc13026cd99 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cb785bf7de43e7827371820617997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0e9dab1a604c38a20588ca05dae79c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 11:03:29.955347 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-3eb76cb7-60c4-4bd2-8e02-8cc13026cd99 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] 10.222.0.59 "GET /compute/v2.1/servers/680585a4-099f-470f-89db-cc4694bdb54f" status: 200 len: 1095 microversion: 2.1 time: 0.067115 Jun 30 11:03:29.955998 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 646/1274] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 11:03:29 2022] GET /compute/v2.1/servers/680585a4-099f-470f-89db-cc4694bdb54f => generated 1095 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 11:03:30.974487 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-f7f605dc-c791-4e05-9779-a2f46f4dfd2e tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 11:03:30.975130 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-f7f605dc-c791-4e05-9779-a2f46f4dfd2e tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] [instance: 680585a4-099f-470f-89db-cc4694bdb54f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 11:03:30.981870 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f7f605dc-c791-4e05-9779-a2f46f4dfd2e tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:03:30.982321 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f7f605dc-c791-4e05-9779-a2f46f4dfd2e tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:03:30.983084 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f7f605dc-c791-4e05-9779-a2f46f4dfd2e tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:03:30.983522 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-f7f605dc-c791-4e05-9779-a2f46f4dfd2e tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:03:31.043928 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-f7f605dc-c791-4e05-9779-a2f46f4dfd2e tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cb785bf7de43e7827371820617997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0e9dab1a604c38a20588ca05dae79c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 11:03:31.051291 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-f7f605dc-c791-4e05-9779-a2f46f4dfd2e tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] 10.222.0.59 "GET /compute/v2.1/servers/680585a4-099f-470f-89db-cc4694bdb54f" status: 200 len: 1145 microversion: 2.1 time: 0.080709 Jun 30 11:03:31.051857 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 629/1275] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 11:03:30 2022] GET /compute/v2.1/servers/680585a4-099f-470f-89db-cc4694bdb54f => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 11:03:32.074868 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-4eb3af5c-0b26-4d0e-8387-8d4c2fff7ecd tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 11:03:32.075584 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-4eb3af5c-0b26-4d0e-8387-8d4c2fff7ecd tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] [instance: 680585a4-099f-470f-89db-cc4694bdb54f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 11:03:32.083969 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-4eb3af5c-0b26-4d0e-8387-8d4c2fff7ecd tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:03:32.084511 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-4eb3af5c-0b26-4d0e-8387-8d4c2fff7ecd tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:03:32.085474 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-4eb3af5c-0b26-4d0e-8387-8d4c2fff7ecd tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:03:32.085990 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-4eb3af5c-0b26-4d0e-8387-8d4c2fff7ecd tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:03:32.160581 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-4eb3af5c-0b26-4d0e-8387-8d4c2fff7ecd tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cb785bf7de43e7827371820617997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0e9dab1a604c38a20588ca05dae79c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 11:03:32.172597 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-4eb3af5c-0b26-4d0e-8387-8d4c2fff7ecd tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] 10.222.0.59 "GET /compute/v2.1/servers/680585a4-099f-470f-89db-cc4694bdb54f" status: 200 len: 1211 microversion: 2.1 time: 0.102067 Jun 30 11:03:32.173279 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 647/1276] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 11:03:32 2022] GET /compute/v2.1/servers/680585a4-099f-470f-89db-cc4694bdb54f => generated 1211 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 11:03:33.012017 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [req-75f8142f-78f7-4c36-b6d9-600362407248 req-5dd26099-3d7a-43e8-9e8b-5df2d95d1b8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "680585a4-099f-470f-89db-cc4694bdb54f", "tag": "76e429a4-5976-4424-bb4d-49a9ef1f165b"}]} {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 11:03:33.022870 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-75f8142f-78f7-4c36-b6d9-600362407248 req-5dd26099-3d7a-43e8-9e8b-5df2d95d1b8a service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:03:33.023317 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [req-75f8142f-78f7-4c36-b6d9-600362407248 req-5dd26099-3d7a-43e8-9e8b-5df2d95d1b8a service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:03:33.036620 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.compute.server_external_events [req-75f8142f-78f7-4c36-b6d9-600362407248 req-5dd26099-3d7a-43e8-9e8b-5df2d95d1b8a service nova] Creating event network-changed:76e429a4-5976-4424-bb4d-49a9ef1f165b for instance 680585a4-099f-470f-89db-cc4694bdb54f on hv-cinder-82282 Jun 30 11:03:33.040405 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR oslo.messaging._drivers.impl_rabbit [req-75f8142f-78f7-4c36-b6d9-600362407248 req-5dd26099-3d7a-43e8-9e8b-5df2d95d1b8a service nova] [8df68164-47ab-4d00-91c1-650534dc0686] AMQP server on 10.222.0.59:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 30 11:03:33.190515 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-a358f927-b85b-4c80-acf4-58e4eadf7b0e tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 11:03:33.191123 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-a358f927-b85b-4c80-acf4-58e4eadf7b0e tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] [instance: 680585a4-099f-470f-89db-cc4694bdb54f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 11:03:33.197807 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a358f927-b85b-4c80-acf4-58e4eadf7b0e tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:03:33.198256 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a358f927-b85b-4c80-acf4-58e4eadf7b0e tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:03:33.199055 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a358f927-b85b-4c80-acf4-58e4eadf7b0e tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:03:33.199489 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a358f927-b85b-4c80-acf4-58e4eadf7b0e tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:03:33.331471 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-a358f927-b85b-4c80-acf4-58e4eadf7b0e tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cb785bf7de43e7827371820617997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0e9dab1a604c38a20588ca05dae79c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 11:03:33.340260 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-a358f927-b85b-4c80-acf4-58e4eadf7b0e tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] 10.222.0.59 "GET /compute/v2.1/servers/680585a4-099f-470f-89db-cc4694bdb54f" status: 200 len: 1267 microversion: 2.1 time: 0.153557 Jun 30 11:03:33.341137 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 648/1277] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 11:03:33 2022] GET /compute/v2.1/servers/680585a4-099f-470f-89db-cc4694bdb54f => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 11:03:34.047437 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO oslo.messaging._drivers.impl_rabbit [req-75f8142f-78f7-4c36-b6d9-600362407248 req-5dd26099-3d7a-43e8-9e8b-5df2d95d1b8a service nova] [8df68164-47ab-4d00-91c1-650534dc0686] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 58662. Jun 30 11:03:34.051120 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [req-75f8142f-78f7-4c36-b6d9-600362407248 req-5dd26099-3d7a-43e8-9e8b-5df2d95d1b8a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.121876 Jun 30 11:03:34.051717 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 630/1278] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 11:03:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 11:03:34.357408 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-ce1aa795-7bc3-46d2-bb7e-46ca9f64983c tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 11:03:34.358057 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-ce1aa795-7bc3-46d2-bb7e-46ca9f64983c tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] [instance: 680585a4-099f-470f-89db-cc4694bdb54f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 11:03:34.364778 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ce1aa795-7bc3-46d2-bb7e-46ca9f64983c tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:03:34.365220 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ce1aa795-7bc3-46d2-bb7e-46ca9f64983c tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:03:34.366011 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ce1aa795-7bc3-46d2-bb7e-46ca9f64983c tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:03:34.366439 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-ce1aa795-7bc3-46d2-bb7e-46ca9f64983c tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:03:34.502223 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-ce1aa795-7bc3-46d2-bb7e-46ca9f64983c tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cb785bf7de43e7827371820617997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0e9dab1a604c38a20588ca05dae79c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 11:03:34.510054 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-ce1aa795-7bc3-46d2-bb7e-46ca9f64983c tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] 10.222.0.59 "GET /compute/v2.1/servers/680585a4-099f-470f-89db-cc4694bdb54f" status: 200 len: 1267 microversion: 2.1 time: 0.156432 Jun 30 11:03:34.510550 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 649/1279] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 11:03:34 2022] GET /compute/v2.1/servers/680585a4-099f-470f-89db-cc4694bdb54f => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 11:03:34.552862 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 11:03:34.553104 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Thu Jun 30 11:03:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 11:03:35.527809 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-99feb71c-5d55-4431-ba42-72a3e6703a6b tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 11:03:35.528438 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-99feb71c-5d55-4431-ba42-72a3e6703a6b tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] [instance: 680585a4-099f-470f-89db-cc4694bdb54f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 11:03:35.534721 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-99feb71c-5d55-4431-ba42-72a3e6703a6b tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:03:35.535169 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-99feb71c-5d55-4431-ba42-72a3e6703a6b tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:03:35.535927 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-99feb71c-5d55-4431-ba42-72a3e6703a6b tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:03:35.536365 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-99feb71c-5d55-4431-ba42-72a3e6703a6b tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:03:35.667119 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-99feb71c-5d55-4431-ba42-72a3e6703a6b tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cb785bf7de43e7827371820617997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0e9dab1a604c38a20588ca05dae79c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 11:03:35.675215 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-99feb71c-5d55-4431-ba42-72a3e6703a6b tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] 10.222.0.59 "GET /compute/v2.1/servers/680585a4-099f-470f-89db-cc4694bdb54f" status: 200 len: 1267 microversion: 2.1 time: 0.152207 Jun 30 11:03:35.675773 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 631/1280] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 11:03:35 2022] GET /compute/v2.1/servers/680585a4-099f-470f-89db-cc4694bdb54f => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 11:03:36.691128 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-98c8b002-6c9b-437e-bd2f-7966df79d690 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 11:03:36.691764 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-98c8b002-6c9b-437e-bd2f-7966df79d690 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] [instance: 680585a4-099f-470f-89db-cc4694bdb54f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 11:03:36.694130 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_cell0:SELECT=2 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 11:03:36.700541 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-98c8b002-6c9b-437e-bd2f-7966df79d690 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:03:36.701004 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-98c8b002-6c9b-437e-bd2f-7966df79d690 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:03:36.702080 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-98c8b002-6c9b-437e-bd2f-7966df79d690 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:03:36.702524 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-98c8b002-6c9b-437e-bd2f-7966df79d690 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:03:36.835484 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-98c8b002-6c9b-437e-bd2f-7966df79d690 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cb785bf7de43e7827371820617997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0e9dab1a604c38a20588ca05dae79c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 11:03:36.842820 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-98c8b002-6c9b-437e-bd2f-7966df79d690 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] 10.222.0.59 "GET /compute/v2.1/servers/680585a4-099f-470f-89db-cc4694bdb54f" status: 200 len: 1267 microversion: 2.1 time: 0.155588 Jun 30 11:03:36.843381 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 650/1281] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 11:03:36 2022] GET /compute/v2.1/servers/680585a4-099f-470f-89db-cc4694bdb54f => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 11:03:37.070766 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 11:03:37.071269 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Thu Jun 30 11:03:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 11:03:37.859914 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-8ae4d79d-9fc5-437b-9403-0c456e8ab8c7 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 11:03:37.860527 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-8ae4d79d-9fc5-437b-9403-0c456e8ab8c7 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] [instance: 680585a4-099f-470f-89db-cc4694bdb54f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 11:03:37.867123 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-8ae4d79d-9fc5-437b-9403-0c456e8ab8c7 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:03:37.867810 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-8ae4d79d-9fc5-437b-9403-0c456e8ab8c7 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:03:37.868586 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-8ae4d79d-9fc5-437b-9403-0c456e8ab8c7 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:03:37.869010 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-8ae4d79d-9fc5-437b-9403-0c456e8ab8c7 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:03:37.999356 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-8ae4d79d-9fc5-437b-9403-0c456e8ab8c7 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cb785bf7de43e7827371820617997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0e9dab1a604c38a20588ca05dae79c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 11:03:38.006703 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-8ae4d79d-9fc5-437b-9403-0c456e8ab8c7 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] 10.222.0.59 "GET /compute/v2.1/servers/680585a4-099f-470f-89db-cc4694bdb54f" status: 200 len: 1267 microversion: 2.1 time: 0.151184 Jun 30 11:03:38.007315 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 632/1282] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 11:03:37 2022] GET /compute/v2.1/servers/680585a4-099f-470f-89db-cc4694bdb54f => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 11:03:39.023164 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-655f861a-e760-4ef2-92ec-959a394404cd tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 11:03:39.023798 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-655f861a-e760-4ef2-92ec-959a394404cd tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] [instance: 680585a4-099f-470f-89db-cc4694bdb54f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 11:03:39.030918 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-655f861a-e760-4ef2-92ec-959a394404cd tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:03:39.031358 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-655f861a-e760-4ef2-92ec-959a394404cd tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:03:39.032106 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-655f861a-e760-4ef2-92ec-959a394404cd tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:03:39.032596 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-655f861a-e760-4ef2-92ec-959a394404cd tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:03:39.166144 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-655f861a-e760-4ef2-92ec-959a394404cd tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cb785bf7de43e7827371820617997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0e9dab1a604c38a20588ca05dae79c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 11:03:39.173584 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-655f861a-e760-4ef2-92ec-959a394404cd tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] 10.222.0.59 "GET /compute/v2.1/servers/680585a4-099f-470f-89db-cc4694bdb54f" status: 200 len: 1267 microversion: 2.1 time: 0.154240 Jun 30 11:03:39.174174 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 651/1283] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 11:03:39 2022] GET /compute/v2.1/servers/680585a4-099f-470f-89db-cc4694bdb54f => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 11:03:40.190223 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-0d09d5af-eb05-465d-9a6a-14cedc2f1450 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 11:03:40.190826 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-0d09d5af-eb05-465d-9a6a-14cedc2f1450 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] [instance: 680585a4-099f-470f-89db-cc4694bdb54f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 11:03:40.193072 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_cell0:SELECT=4 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 11:03:40.198482 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-0d09d5af-eb05-465d-9a6a-14cedc2f1450 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:03:40.198923 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-0d09d5af-eb05-465d-9a6a-14cedc2f1450 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:03:40.199669 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-0d09d5af-eb05-465d-9a6a-14cedc2f1450 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:03:40.200097 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-0d09d5af-eb05-465d-9a6a-14cedc2f1450 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:03:40.327268 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-0d09d5af-eb05-465d-9a6a-14cedc2f1450 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cb785bf7de43e7827371820617997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0e9dab1a604c38a20588ca05dae79c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 11:03:40.334670 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-0d09d5af-eb05-465d-9a6a-14cedc2f1450 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] 10.222.0.59 "GET /compute/v2.1/servers/680585a4-099f-470f-89db-cc4694bdb54f" status: 200 len: 1267 microversion: 2.1 time: 0.148245 Jun 30 11:03:40.335228 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 633/1284] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 11:03:40 2022] GET /compute/v2.1/servers/680585a4-099f-470f-89db-cc4694bdb54f => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 11:03:41.351150 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-690ff7da-77c3-4c64-96cd-42fce0a7d0a4 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 11:03:41.351753 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-690ff7da-77c3-4c64-96cd-42fce0a7d0a4 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] [instance: 680585a4-099f-470f-89db-cc4694bdb54f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 11:03:41.353590 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_cell0:SELECT=10 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 11:03:41.359484 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-690ff7da-77c3-4c64-96cd-42fce0a7d0a4 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:03:41.360014 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-690ff7da-77c3-4c64-96cd-42fce0a7d0a4 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:03:41.360825 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-690ff7da-77c3-4c64-96cd-42fce0a7d0a4 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:03:41.361264 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-690ff7da-77c3-4c64-96cd-42fce0a7d0a4 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:03:41.490090 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-690ff7da-77c3-4c64-96cd-42fce0a7d0a4 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cb785bf7de43e7827371820617997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0e9dab1a604c38a20588ca05dae79c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 11:03:41.497750 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-690ff7da-77c3-4c64-96cd-42fce0a7d0a4 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] 10.222.0.59 "GET /compute/v2.1/servers/680585a4-099f-470f-89db-cc4694bdb54f" status: 200 len: 1267 microversion: 2.1 time: 0.150409 Jun 30 11:03:41.498318 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 652/1285] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 11:03:41 2022] GET /compute/v2.1/servers/680585a4-099f-470f-89db-cc4694bdb54f => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 11:03:42.514526 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-da96ab33-5a5c-43c2-bd4f-b6988986d286 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 11:03:42.515070 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-da96ab33-5a5c-43c2-bd4f-b6988986d286 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] [instance: 680585a4-099f-470f-89db-cc4694bdb54f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 11:03:42.521595 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-da96ab33-5a5c-43c2-bd4f-b6988986d286 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:03:42.522044 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-da96ab33-5a5c-43c2-bd4f-b6988986d286 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:03:42.522803 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-da96ab33-5a5c-43c2-bd4f-b6988986d286 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:03:42.523244 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-da96ab33-5a5c-43c2-bd4f-b6988986d286 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:03:42.668351 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-da96ab33-5a5c-43c2-bd4f-b6988986d286 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cb785bf7de43e7827371820617997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0e9dab1a604c38a20588ca05dae79c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 11:03:42.676401 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-da96ab33-5a5c-43c2-bd4f-b6988986d286 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] 10.222.0.59 "GET /compute/v2.1/servers/680585a4-099f-470f-89db-cc4694bdb54f" status: 200 len: 1267 microversion: 2.1 time: 0.165848 Jun 30 11:03:42.676981 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 634/1286] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 11:03:42 2022] GET /compute/v2.1/servers/680585a4-099f-470f-89db-cc4694bdb54f => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 11:03:42.913982 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [req-cc34f50d-24d4-4927-8eb0-41dca01a7cc7 req-aaa6798e-9a03-4df5-9225-694b6c7a379b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "680585a4-099f-470f-89db-cc4694bdb54f", "name": "network-vif-plugged", "status": "completed", "tag": "76e429a4-5976-4424-bb4d-49a9ef1f165b"}]} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 11:03:42.922163 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-cc34f50d-24d4-4927-8eb0-41dca01a7cc7 req-aaa6798e-9a03-4df5-9225-694b6c7a379b service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:03:42.922610 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-cc34f50d-24d4-4927-8eb0-41dca01a7cc7 req-aaa6798e-9a03-4df5-9225-694b6c7a379b service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:03:42.933740 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.compute.server_external_events [req-cc34f50d-24d4-4927-8eb0-41dca01a7cc7 req-aaa6798e-9a03-4df5-9225-694b6c7a379b service nova] Creating event network-vif-plugged:76e429a4-5976-4424-bb4d-49a9ef1f165b for instance 680585a4-099f-470f-89db-cc4694bdb54f on hv-cinder-82282 Jun 30 11:03:42.937380 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR oslo.messaging._drivers.impl_rabbit [req-cc34f50d-24d4-4927-8eb0-41dca01a7cc7 req-aaa6798e-9a03-4df5-9225-694b6c7a379b service nova] [5d3533fc-b123-4b6d-aaef-95643dc4caf2] AMQP server on 10.222.0.59:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 30 11:03:43.692913 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-01ce4414-8a0d-4886-b31a-c58e5a925519 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 11:03:43.693528 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-01ce4414-8a0d-4886-b31a-c58e5a925519 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] [instance: 680585a4-099f-470f-89db-cc4694bdb54f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 11:03:43.700044 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-01ce4414-8a0d-4886-b31a-c58e5a925519 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:03:43.701023 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-01ce4414-8a0d-4886-b31a-c58e5a925519 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:03:43.701792 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-01ce4414-8a0d-4886-b31a-c58e5a925519 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:03:43.702230 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-01ce4414-8a0d-4886-b31a-c58e5a925519 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:03:43.828641 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-01ce4414-8a0d-4886-b31a-c58e5a925519 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cb785bf7de43e7827371820617997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0e9dab1a604c38a20588ca05dae79c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 11:03:43.836292 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-01ce4414-8a0d-4886-b31a-c58e5a925519 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] 10.222.0.59 "GET /compute/v2.1/servers/680585a4-099f-470f-89db-cc4694bdb54f" status: 200 len: 1267 microversion: 2.1 time: 0.147277 Jun 30 11:03:43.836887 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 635/1287] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 11:03:43 2022] GET /compute/v2.1/servers/680585a4-099f-470f-89db-cc4694bdb54f => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 11:03:43.943945 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO oslo.messaging._drivers.impl_rabbit [req-cc34f50d-24d4-4927-8eb0-41dca01a7cc7 req-aaa6798e-9a03-4df5-9225-694b6c7a379b service nova] [5d3533fc-b123-4b6d-aaef-95643dc4caf2] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 58698. Jun 30 11:03:43.947658 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [req-cc34f50d-24d4-4927-8eb0-41dca01a7cc7 req-aaa6798e-9a03-4df5-9225-694b6c7a379b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.088611 Jun 30 11:03:43.948407 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 653/1288] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 11:03:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 11:03:44.853686 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-310dd3cf-3743-40ec-9ef4-b35757e4a251 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 11:03:44.854285 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-310dd3cf-3743-40ec-9ef4-b35757e4a251 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] [instance: 680585a4-099f-470f-89db-cc4694bdb54f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 11:03:44.861278 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-310dd3cf-3743-40ec-9ef4-b35757e4a251 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:03:44.861715 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-310dd3cf-3743-40ec-9ef4-b35757e4a251 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:03:44.862463 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-310dd3cf-3743-40ec-9ef4-b35757e4a251 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:03:44.862891 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-310dd3cf-3743-40ec-9ef4-b35757e4a251 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:03:44.993758 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-310dd3cf-3743-40ec-9ef4-b35757e4a251 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cb785bf7de43e7827371820617997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0e9dab1a604c38a20588ca05dae79c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 11:03:45.001327 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-310dd3cf-3743-40ec-9ef4-b35757e4a251 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] 10.222.0.59 "GET /compute/v2.1/servers/680585a4-099f-470f-89db-cc4694bdb54f" status: 200 len: 1267 microversion: 2.1 time: 0.151711 Jun 30 11:03:45.001906 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 636/1289] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 11:03:44 2022] GET /compute/v2.1/servers/680585a4-099f-470f-89db-cc4694bdb54f => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 11:03:46.019452 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-dfee6889-3f1f-4485-93dd-a17b5c89c745 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 11:03:46.020149 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-dfee6889-3f1f-4485-93dd-a17b5c89c745 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] [instance: 680585a4-099f-470f-89db-cc4694bdb54f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 11:03:46.026409 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-dfee6889-3f1f-4485-93dd-a17b5c89c745 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:03:46.026862 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-dfee6889-3f1f-4485-93dd-a17b5c89c745 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:03:46.027629 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-dfee6889-3f1f-4485-93dd-a17b5c89c745 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:03:46.028073 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-dfee6889-3f1f-4485-93dd-a17b5c89c745 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:03:46.157410 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-dfee6889-3f1f-4485-93dd-a17b5c89c745 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cb785bf7de43e7827371820617997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0e9dab1a604c38a20588ca05dae79c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 11:03:46.164972 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-dfee6889-3f1f-4485-93dd-a17b5c89c745 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] 10.222.0.59 "GET /compute/v2.1/servers/680585a4-099f-470f-89db-cc4694bdb54f" status: 200 len: 1454 microversion: 2.1 time: 0.150198 Jun 30 11:03:46.165537 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 654/1290] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 11:03:46 2022] GET /compute/v2.1/servers/680585a4-099f-470f-89db-cc4694bdb54f => generated 1454 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 11:03:46.180776 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-ad83569b-4a95-4142-a7dc-a49ab28ae5e3 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 11:03:46.181382 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-ad83569b-4a95-4142-a7dc-a49ab28ae5e3 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] [instance: 680585a4-099f-470f-89db-cc4694bdb54f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 11:03:46.188193 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ad83569b-4a95-4142-a7dc-a49ab28ae5e3 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:03:46.188655 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ad83569b-4a95-4142-a7dc-a49ab28ae5e3 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:03:46.189407 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ad83569b-4a95-4142-a7dc-a49ab28ae5e3 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:03:46.189832 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-ad83569b-4a95-4142-a7dc-a49ab28ae5e3 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:03:46.316742 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-ad83569b-4a95-4142-a7dc-a49ab28ae5e3 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cb785bf7de43e7827371820617997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0e9dab1a604c38a20588ca05dae79c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 11:03:46.324115 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-ad83569b-4a95-4142-a7dc-a49ab28ae5e3 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] 10.222.0.59 "GET /compute/v2.1/servers/680585a4-099f-470f-89db-cc4694bdb54f" status: 200 len: 1454 microversion: 2.1 time: 0.147261 Jun 30 11:03:46.324708 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 637/1291] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 11:03:46 2022] GET /compute/v2.1/servers/680585a4-099f-470f-89db-cc4694bdb54f => generated 1454 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 11:03:47.952493 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [req-b5e2c33a-ea97-41fc-af96-4aa3d07a660d req-84b79e87-57cb-4a3c-9f59-2ae52aaf5b4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "680585a4-099f-470f-89db-cc4694bdb54f", "tag": "76e429a4-5976-4424-bb4d-49a9ef1f165b"}]} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 11:03:47.960702 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-b5e2c33a-ea97-41fc-af96-4aa3d07a660d req-84b79e87-57cb-4a3c-9f59-2ae52aaf5b4c service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:03:47.961390 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-b5e2c33a-ea97-41fc-af96-4aa3d07a660d req-84b79e87-57cb-4a3c-9f59-2ae52aaf5b4c service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:03:47.975113 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.compute.server_external_events [req-b5e2c33a-ea97-41fc-af96-4aa3d07a660d req-84b79e87-57cb-4a3c-9f59-2ae52aaf5b4c service nova] Creating event network-changed:76e429a4-5976-4424-bb4d-49a9ef1f165b for instance 680585a4-099f-470f-89db-cc4694bdb54f on hv-cinder-82282 Jun 30 11:03:47.980495 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [req-b5e2c33a-ea97-41fc-af96-4aa3d07a660d req-84b79e87-57cb-4a3c-9f59-2ae52aaf5b4c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080499 Jun 30 11:03:47.981187 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 655/1292] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 11:03:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 11:05:12.870070 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 11:05:12.870680 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Thu Jun 30 11:05:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 11:05:38.647010 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR oslo.messaging._drivers.impl_rabbit [-] [25aec510-371a-4945-b64f-dffd1b886ba0] AMQP server on 10.222.0.59:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jun 30 11:05:38.647663 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 11:05:38.648345 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG dbcounter [-] [124203] Writing DB stats nova_cell1:SELECT=48 {{(pid=124203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 11:05:38.653404 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_api:SELECT=26 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 11:05:38.654533 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG dbcounter [-] [124204] Writing DB stats nova_cell1:SELECT=50 {{(pid=124204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 11:05:38.658770 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-343df29a-59fa-4a22-b9fb-52a02ac253cd tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 11:05:38.659305 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-343df29a-59fa-4a22-b9fb-52a02ac253cd tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] [instance: 680585a4-099f-470f-89db-cc4694bdb54f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 11:05:38.661817 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [req-9dff8854-2c61-47f7-8526-b4e19c96a7f1 req-f3669b30-5852-4e1b-9cb1-e8f51b957b65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "680585a4-099f-470f-89db-cc4694bdb54f", "tag": "76e429a4-5976-4424-bb4d-49a9ef1f165b"}]} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 11:05:38.674805 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-343df29a-59fa-4a22-b9fb-52a02ac253cd tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:05:38.675256 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-343df29a-59fa-4a22-b9fb-52a02ac253cd tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:05:38.676036 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-343df29a-59fa-4a22-b9fb-52a02ac253cd tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:05:38.676475 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-343df29a-59fa-4a22-b9fb-52a02ac253cd tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:05:38.682165 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-9dff8854-2c61-47f7-8526-b4e19c96a7f1 req-f3669b30-5852-4e1b-9cb1-e8f51b957b65 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:05:38.682548 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-9dff8854-2c61-47f7-8526-b4e19c96a7f1 req-f3669b30-5852-4e1b-9cb1-e8f51b957b65 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:05:38.694061 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.compute.server_external_events [req-9dff8854-2c61-47f7-8526-b4e19c96a7f1 req-f3669b30-5852-4e1b-9cb1-e8f51b957b65 service nova] Creating event network-changed:76e429a4-5976-4424-bb4d-49a9ef1f165b for instance 680585a4-099f-470f-89db-cc4694bdb54f on hv-cinder-82282 Jun 30 11:05:38.699689 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [req-9dff8854-2c61-47f7-8526-b4e19c96a7f1 req-f3669b30-5852-4e1b-9cb1-e8f51b957b65 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054209 Jun 30 11:05:38.700309 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 656/1293] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 11:05:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 11:05:38.705206 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-343df29a-59fa-4a22-b9fb-52a02ac253cd tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] [instance: 680585a4-099f-470f-89db-cc4694bdb54f] Going to try to terminate instance {{(pid=124204) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 11:05:38.791732 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-343df29a-59fa-4a22-b9fb-52a02ac253cd tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] 10.222.0.59 "DELETE /compute/v2.1/servers/680585a4-099f-470f-89db-cc4694bdb54f" status: 204 len: 0 microversion: 2.1 time: 0.149308 Jun 30 11:05:38.792490 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 638/1294] 10.222.0.59 () {58 vars in 1238 bytes} [Thu Jun 30 11:05:38 2022] DELETE /compute/v2.1/servers/680585a4-099f-470f-89db-cc4694bdb54f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 11:05:38.801393 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-78c3f98f-a1cc-4f96-a66a-bcff0aba756a tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 11:05:38.802090 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-78c3f98f-a1cc-4f96-a66a-bcff0aba756a tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] [instance: 680585a4-099f-470f-89db-cc4694bdb54f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 11:05:38.809720 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-78c3f98f-a1cc-4f96-a66a-bcff0aba756a tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:05:38.810173 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-78c3f98f-a1cc-4f96-a66a-bcff0aba756a tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:05:38.810945 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-78c3f98f-a1cc-4f96-a66a-bcff0aba756a tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:05:38.812411 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-78c3f98f-a1cc-4f96-a66a-bcff0aba756a tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:05:38.951627 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-78c3f98f-a1cc-4f96-a66a-bcff0aba756a tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cb785bf7de43e7827371820617997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0e9dab1a604c38a20588ca05dae79c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 11:05:38.959237 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-78c3f98f-a1cc-4f96-a66a-bcff0aba756a tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] 10.222.0.59 "GET /compute/v2.1/servers/680585a4-099f-470f-89db-cc4694bdb54f" status: 200 len: 1578 microversion: 2.1 time: 0.162178 Jun 30 11:05:38.959807 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 657/1295] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 11:05:38 2022] GET /compute/v2.1/servers/680585a4-099f-470f-89db-cc4694bdb54f => generated 1578 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 11:05:39.978710 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-08f2202a-ecdf-47f4-8577-0c9f5c17ea38 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 11:05:39.979341 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-08f2202a-ecdf-47f4-8577-0c9f5c17ea38 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] [instance: 680585a4-099f-470f-89db-cc4694bdb54f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 11:05:39.986007 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-08f2202a-ecdf-47f4-8577-0c9f5c17ea38 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:05:39.986458 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-08f2202a-ecdf-47f4-8577-0c9f5c17ea38 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:05:39.987226 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-08f2202a-ecdf-47f4-8577-0c9f5c17ea38 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:05:39.987669 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-08f2202a-ecdf-47f4-8577-0c9f5c17ea38 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:05:40.125767 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-08f2202a-ecdf-47f4-8577-0c9f5c17ea38 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cb785bf7de43e7827371820617997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0e9dab1a604c38a20588ca05dae79c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 11:05:40.133300 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-08f2202a-ecdf-47f4-8577-0c9f5c17ea38 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] 10.222.0.59 "GET /compute/v2.1/servers/680585a4-099f-470f-89db-cc4694bdb54f" status: 200 len: 1578 microversion: 2.1 time: 0.158946 Jun 30 11:05:40.133876 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 639/1296] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 11:05:39 2022] GET /compute/v2.1/servers/680585a4-099f-470f-89db-cc4694bdb54f => generated 1578 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 11:05:40.874766 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [req-a7ebe015-4f4a-4103-be8c-2e35c60a17e6 req-8458f05e-f6b8-43c8-8868-71cfa9e6861c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "680585a4-099f-470f-89db-cc4694bdb54f", "name": "network-vif-deleted", "tag": "76e429a4-5976-4424-bb4d-49a9ef1f165b"}]} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 11:05:40.891824 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-a7ebe015-4f4a-4103-be8c-2e35c60a17e6 req-8458f05e-f6b8-43c8-8868-71cfa9e6861c service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:05:40.892273 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-a7ebe015-4f4a-4103-be8c-2e35c60a17e6 req-8458f05e-f6b8-43c8-8868-71cfa9e6861c service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:05:40.896790 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO oslo.messaging._drivers.impl_rabbit [-] [25aec510-371a-4945-b64f-dffd1b886ba0] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 58760. Jun 30 11:05:40.905415 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.compute.server_external_events [req-a7ebe015-4f4a-4103-be8c-2e35c60a17e6 req-8458f05e-f6b8-43c8-8868-71cfa9e6861c service nova] Creating event network-vif-deleted:76e429a4-5976-4424-bb4d-49a9ef1f165b for instance 680585a4-099f-470f-89db-cc4694bdb54f on hv-cinder-82282 Jun 30 11:05:40.911299 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [req-a7ebe015-4f4a-4103-be8c-2e35c60a17e6 req-8458f05e-f6b8-43c8-8868-71cfa9e6861c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041733 Jun 30 11:05:40.911891 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 658/1297] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 11:05:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 11:05:41.150023 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-3d295dc0-c120-4a2b-a1c3-d3c2beee5a11 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 11:05:41.150637 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-3d295dc0-c120-4a2b-a1c3-d3c2beee5a11 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] [instance: 680585a4-099f-470f-89db-cc4694bdb54f] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 11:05:41.158226 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-3d295dc0-c120-4a2b-a1c3-d3c2beee5a11 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:05:41.158963 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-3d295dc0-c120-4a2b-a1c3-d3c2beee5a11 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:05:41.159923 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-3d295dc0-c120-4a2b-a1c3-d3c2beee5a11 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:05:41.160535 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-3d295dc0-c120-4a2b-a1c3-d3c2beee5a11 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:05:41.231383 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-3d295dc0-c120-4a2b-a1c3-d3c2beee5a11 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cb785bf7de43e7827371820617997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0e9dab1a604c38a20588ca05dae79c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 11:05:41.239689 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-3d295dc0-c120-4a2b-a1c3-d3c2beee5a11 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] 10.222.0.59 "GET /compute/v2.1/servers/680585a4-099f-470f-89db-cc4694bdb54f" status: 200 len: 1226 microversion: 2.1 time: 0.093509 Jun 30 11:05:41.240270 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 640/1298] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 11:05:41 2022] GET /compute/v2.1/servers/680585a4-099f-470f-89db-cc4694bdb54f => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 11:05:42.257544 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-bae98c7b-37e9-4a27-bb88-41dfe712c6a0 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 11:05:42.258246 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-bae98c7b-37e9-4a27-bb88-41dfe712c6a0 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] [instance: 680585a4-099f-470f-89db-cc4694bdb54f] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 11:05:42.265271 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-bae98c7b-37e9-4a27-bb88-41dfe712c6a0 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:05:42.267061 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-bae98c7b-37e9-4a27-bb88-41dfe712c6a0 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:05:42.267835 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-bae98c7b-37e9-4a27-bb88-41dfe712c6a0 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:05:42.268278 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-bae98c7b-37e9-4a27-bb88-41dfe712c6a0 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:05:42.281438 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.wsgi [None req-bae98c7b-37e9-4a27-bb88-41dfe712c6a0 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] HTTP exception thrown: Instance 680585a4-099f-470f-89db-cc4694bdb54f could not be found. Jun 30 11:05:42.283066 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-bae98c7b-37e9-4a27-bb88-41dfe712c6a0 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Request method failure captured: Jun 30 11:05:42.283066 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: request: GET /compute/v2.1/servers/680585a4-099f-470f-89db-cc4694bdb54f HTTP/1.1 Jun 30 11:05:42.283066 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Accept: application/json Jun 30 11:05:42.283066 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Accept-Encoding: identity Jun 30 11:05:42.283066 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Connection: close Jun 30 11:05:42.283066 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Content-Length: 0 Jun 30 11:05:42.283066 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Content-Type: application/json Jun 30 11:05:42.283066 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Host: 10.222.0.59 Jun 30 11:05:42.283066 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Openstack-System-Scope: None Jun 30 11:05:42.283066 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: User-Agent: python-urllib3/1.26.9 Jun 30 11:05:42.283066 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Auth-Token: gAAAAABivYGrLve2IUh4L8jW8mhZoRjMEZxnRQxLSjSEdkCAqgqw5gWtKoYCqHRatqTQNg2ay44u7t9OZ_y1NASaicjP-oZ8N5-5g9LoA5SUINPqYX574pGxbHNUS4r4kOERVrLzrGKrFM-g1LLHEs017ETww0gs8gr_Q0upq_FaGvjmrXLZM1w Jun 30 11:05:42.283066 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Domain-Id: None Jun 30 11:05:42.283066 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Domain-Name: None Jun 30 11:05:42.283066 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Identity-Status: Confirmed Jun 30 11:05:42.283066 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Is-Admin-Project: True Jun 30 11:05:42.283066 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Domain-Id: default Jun 30 11:05:42.283066 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Domain-Name: Default Jun 30 11:05:42.283066 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Id: 5c0e9dab1a604c38a20588ca05dae79c Jun 30 11:05:42.283066 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Name: tempest-TestVolumeBootPattern-911516623 Jun 30 11:05:42.283066 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Role: member,reader Jun 30 11:05:42.283066 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Roles: member,reader Jun 30 11:05:42.284902 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5c0e9dab1a604c38a20588ca05dae79c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5c0e9dab1a604c38a20588ca05dae79c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5c0e9dab1a604c38a20588ca05dae79c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5c0e9dab1a604c38a20588ca05dae79c"}]}] Jun 30 11:05:42.284902 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant: tempest-TestVolumeBootPattern-911516623 Jun 30 11:05:42.284902 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant-Id: 5c0e9dab1a604c38a20588ca05dae79c Jun 30 11:05:42.284902 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant-Name: tempest-TestVolumeBootPattern-911516623 Jun 30 11:05:42.284902 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User: tempest-TestVolumeBootPattern-911516623-project Jun 30 11:05:42.284902 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Domain-Id: default Jun 30 11:05:42.284902 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Domain-Name: Default Jun 30 11:05:42.284902 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Id: 30cb785bf7de43e7827371820617997a Jun 30 11:05:42.284902 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Name: tempest-TestVolumeBootPattern-911516623-project Jun 30 11:05:42.284902 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: method: > Jun 30 11:05:42.284902 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: exception: Instance 680585a4-099f-470f-89db-cc4694bdb54f could not be found. Jun 30 11:05:42.284902 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: action_args: {'id': '680585a4-099f-470f-89db-cc4694bdb54f'} Jun 30 11:05:42.285977 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 11:05:42.285977 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 11:05:42.285977 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 11:05:42.285977 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 11:05:42.285977 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 11:05:42.285977 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 11:05:42.285977 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 11:05:42.285977 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 11:05:42.285977 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 11:05:42.285977 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 11:05:42.285977 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 680585a4-099f-470f-89db-cc4694bdb54f could not be found. Jun 30 11:05:42.285977 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 11:05:42.285977 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 11:05:42.285977 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 11:05:42.285977 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 11:05:42.285977 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 11:05:42.285977 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 11:05:42.285977 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 11:05:42.285977 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 11:05:42.285977 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 11:05:42.287706 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 11:05:42.287706 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 11:05:42.287706 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 11:05:42.287706 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 11:05:42.287706 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 11:05:42.287706 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 11:05:42.287706 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 11:05:42.287706 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 680585a4-099f-470f-89db-cc4694bdb54f could not be found. Jun 30 11:05:42.287706 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 11:05:42.287706 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 11:05:42.287706 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 11:05:42.287706 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 11:05:42.287706 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 11:05:42.287706 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 11:05:42.287706 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 11:05:42.287706 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 11:05:42.287706 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 680585a4-099f-470f-89db-cc4694bdb54f could not be found. Jun 30 11:05:42.287706 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 11:05:42.289372 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-bae98c7b-37e9-4a27-bb88-41dfe712c6a0 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Returning 404 to user: Instance 680585a4-099f-470f-89db-cc4694bdb54f could not be found. {{(pid=124203) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 11:05:42.289372 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-bae98c7b-37e9-4a27-bb88-41dfe712c6a0 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] 10.222.0.59 "GET /compute/v2.1/servers/680585a4-099f-470f-89db-cc4694bdb54f" status: 404 len: 111 microversion: 2.1 time: 0.031664 Jun 30 11:05:42.289372 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 659/1299] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 11:05:42 2022] GET /compute/v2.1/servers/680585a4-099f-470f-89db-cc4694bdb54f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 11:05:45.337668 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-1cae683c-59a4-4270-be67-feeb7eaffd88 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 11:05:45.338199 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-1cae683c-59a4-4270-be67-feeb7eaffd88 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] [instance: 37391b9e-a061-4ea4-82bb-b426a9d470d2] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 11:05:45.339189 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [req-ddf87feb-90ec-4ef9-9cf4-e8bcd757ce4e req-34686054-c5f0-4e95-8f2b-150537a81ca3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37391b9e-a061-4ea4-82bb-b426a9d470d2", "tag": "3821e1c5-4d78-4bd6-b133-103d75e6f296"}]} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 11:05:45.345296 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1cae683c-59a4-4270-be67-feeb7eaffd88 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:05:45.345756 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1cae683c-59a4-4270-be67-feeb7eaffd88 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:05:45.346614 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1cae683c-59a4-4270-be67-feeb7eaffd88 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:05:45.347017 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-1cae683c-59a4-4270-be67-feeb7eaffd88 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:05:45.348613 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-ddf87feb-90ec-4ef9-9cf4-e8bcd757ce4e req-34686054-c5f0-4e95-8f2b-150537a81ca3 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:05:45.348865 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-ddf87feb-90ec-4ef9-9cf4-e8bcd757ce4e req-34686054-c5f0-4e95-8f2b-150537a81ca3 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:05:45.361264 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.compute.server_external_events [req-ddf87feb-90ec-4ef9-9cf4-e8bcd757ce4e req-34686054-c5f0-4e95-8f2b-150537a81ca3 service nova] Creating event network-changed:3821e1c5-4d78-4bd6-b133-103d75e6f296 for instance 37391b9e-a061-4ea4-82bb-b426a9d470d2 on hv-cinder-82282 Jun 30 11:05:45.366946 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [req-ddf87feb-90ec-4ef9-9cf4-e8bcd757ce4e req-34686054-c5f0-4e95-8f2b-150537a81ca3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031373 Jun 30 11:05:45.368088 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 660/1300] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 11:05:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 11:05:45.377167 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-1cae683c-59a4-4270-be67-feeb7eaffd88 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] [instance: 37391b9e-a061-4ea4-82bb-b426a9d470d2] Going to try to terminate instance {{(pid=124204) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 11:05:45.462293 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-1cae683c-59a4-4270-be67-feeb7eaffd88 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] 10.222.0.59 "DELETE /compute/v2.1/servers/37391b9e-a061-4ea4-82bb-b426a9d470d2" status: 204 len: 0 microversion: 2.1 time: 0.128193 Jun 30 11:05:45.463216 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 641/1301] 10.222.0.59 () {58 vars in 1238 bytes} [Thu Jun 30 11:05:45 2022] DELETE /compute/v2.1/servers/37391b9e-a061-4ea4-82bb-b426a9d470d2 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 11:05:45.472078 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-b5f3aef7-1b47-419e-94dd-79d37997dfbd tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 11:05:45.473184 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-b5f3aef7-1b47-419e-94dd-79d37997dfbd tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] [instance: 37391b9e-a061-4ea4-82bb-b426a9d470d2] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 11:05:45.480714 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b5f3aef7-1b47-419e-94dd-79d37997dfbd tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:05:45.481173 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b5f3aef7-1b47-419e-94dd-79d37997dfbd tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:05:45.481986 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b5f3aef7-1b47-419e-94dd-79d37997dfbd tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:05:45.482429 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-b5f3aef7-1b47-419e-94dd-79d37997dfbd tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:05:45.619985 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.policy [None req-b5f3aef7-1b47-419e-94dd-79d37997dfbd tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cb785bf7de43e7827371820617997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0e9dab1a604c38a20588ca05dae79c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124203) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 11:05:45.628275 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-b5f3aef7-1b47-419e-94dd-79d37997dfbd tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] 10.222.0.59 "GET /compute/v2.1/servers/37391b9e-a061-4ea4-82bb-b426a9d470d2" status: 200 len: 1579 microversion: 2.1 time: 0.160589 Jun 30 11:05:45.629185 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 661/1302] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 11:05:45 2022] GET /compute/v2.1/servers/37391b9e-a061-4ea4-82bb-b426a9d470d2 => generated 1579 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 11:05:46.645788 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-bca6146a-6869-4da5-aeea-b514a937cba7 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 11:05:46.646491 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-bca6146a-6869-4da5-aeea-b514a937cba7 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] [instance: 37391b9e-a061-4ea4-82bb-b426a9d470d2] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 11:05:46.653417 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-bca6146a-6869-4da5-aeea-b514a937cba7 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:05:46.653870 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-bca6146a-6869-4da5-aeea-b514a937cba7 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:05:46.654640 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-bca6146a-6869-4da5-aeea-b514a937cba7 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:05:46.655077 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-bca6146a-6869-4da5-aeea-b514a937cba7 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:05:46.784783 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-bca6146a-6869-4da5-aeea-b514a937cba7 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cb785bf7de43e7827371820617997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0e9dab1a604c38a20588ca05dae79c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 11:05:46.792936 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-bca6146a-6869-4da5-aeea-b514a937cba7 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] 10.222.0.59 "GET /compute/v2.1/servers/37391b9e-a061-4ea4-82bb-b426a9d470d2" status: 200 len: 1579 microversion: 2.1 time: 0.150834 Jun 30 11:05:46.793503 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 642/1303] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 11:05:46 2022] GET /compute/v2.1/servers/37391b9e-a061-4ea4-82bb-b426a9d470d2 => generated 1579 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 11:05:47.513909 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [req-cf7a6f74-f11d-4a72-8845-87db283f2221 req-9eb6761c-f16b-4cab-8621-bbe62675e3f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37391b9e-a061-4ea4-82bb-b426a9d470d2", "name": "network-vif-deleted", "tag": "3821e1c5-4d78-4bd6-b133-103d75e6f296"}]} {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 11:05:47.522496 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-cf7a6f74-f11d-4a72-8845-87db283f2221 req-9eb6761c-f16b-4cab-8621-bbe62675e3f2 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:05:47.523162 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [req-cf7a6f74-f11d-4a72-8845-87db283f2221 req-9eb6761c-f16b-4cab-8621-bbe62675e3f2 service nova] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:05:47.535029 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.compute.server_external_events [req-cf7a6f74-f11d-4a72-8845-87db283f2221 req-9eb6761c-f16b-4cab-8621-bbe62675e3f2 service nova] Creating event network-vif-deleted:3821e1c5-4d78-4bd6-b133-103d75e6f296 for instance 37391b9e-a061-4ea4-82bb-b426a9d470d2 on hv-cinder-82282 Jun 30 11:05:47.540181 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [req-cf7a6f74-f11d-4a72-8845-87db283f2221 req-9eb6761c-f16b-4cab-8621-bbe62675e3f2 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030050 Jun 30 11:05:47.540804 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 662/1304] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 30 11:05:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 11:05:47.809976 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-8954bd41-2cdd-4cb9-ab31-8ce2c5d241e3 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 11:05:47.810641 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-8954bd41-2cdd-4cb9-ab31-8ce2c5d241e3 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] [instance: 37391b9e-a061-4ea4-82bb-b426a9d470d2] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 11:05:47.817435 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-8954bd41-2cdd-4cb9-ab31-8ce2c5d241e3 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:05:47.817881 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-8954bd41-2cdd-4cb9-ab31-8ce2c5d241e3 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:05:47.818653 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-8954bd41-2cdd-4cb9-ab31-8ce2c5d241e3 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:05:47.819081 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-8954bd41-2cdd-4cb9-ab31-8ce2c5d241e3 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:05:47.852655 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-8954bd41-2cdd-4cb9-ab31-8ce2c5d241e3 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:05:47.853100 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-8954bd41-2cdd-4cb9-ab31-8ce2c5d241e3 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:05:47.853549 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.objects.instance [None req-8954bd41-2cdd-4cb9-ab31-8ce2c5d241e3 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lazy-loading 'fault' on Instance uuid 37391b9e-a061-4ea4-82bb-b426a9d470d2 {{(pid=124204) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 11:05:47.895373 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.policy [None req-8954bd41-2cdd-4cb9-ab31-8ce2c5d241e3 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cb785bf7de43e7827371820617997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0e9dab1a604c38a20588ca05dae79c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124204) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 11:05:47.903995 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-8954bd41-2cdd-4cb9-ab31-8ce2c5d241e3 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] 10.222.0.59 "GET /compute/v2.1/servers/37391b9e-a061-4ea4-82bb-b426a9d470d2" status: 200 len: 1231 microversion: 2.1 time: 0.097862 Jun 30 11:05:47.904590 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 643/1305] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 11:05:47 2022] GET /compute/v2.1/servers/37391b9e-a061-4ea4-82bb-b426a9d470d2 => generated 1231 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 11:05:48.922321 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-a1bd5a80-56b5-4ecf-bf1c-fd15dcecd117 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 11:05:48.923020 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-a1bd5a80-56b5-4ecf-bf1c-fd15dcecd117 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] [instance: 37391b9e-a061-4ea4-82bb-b426a9d470d2] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 11:05:48.929826 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a1bd5a80-56b5-4ecf-bf1c-fd15dcecd117 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:05:48.930277 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a1bd5a80-56b5-4ecf-bf1c-fd15dcecd117 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:05:48.931040 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a1bd5a80-56b5-4ecf-bf1c-fd15dcecd117 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:05:48.931481 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-a1bd5a80-56b5-4ecf-bf1c-fd15dcecd117 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:05:48.945126 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.wsgi [None req-a1bd5a80-56b5-4ecf-bf1c-fd15dcecd117 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] HTTP exception thrown: Instance 37391b9e-a061-4ea4-82bb-b426a9d470d2 could not be found. Jun 30 11:05:48.947585 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-a1bd5a80-56b5-4ecf-bf1c-fd15dcecd117 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Request method failure captured: Jun 30 11:05:48.947585 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: request: GET /compute/v2.1/servers/37391b9e-a061-4ea4-82bb-b426a9d470d2 HTTP/1.1 Jun 30 11:05:48.947585 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Accept: application/json Jun 30 11:05:48.947585 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Accept-Encoding: identity Jun 30 11:05:48.947585 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Connection: close Jun 30 11:05:48.947585 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Content-Length: 0 Jun 30 11:05:48.947585 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Content-Type: application/json Jun 30 11:05:48.947585 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Host: 10.222.0.59 Jun 30 11:05:48.947585 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Openstack-System-Scope: None Jun 30 11:05:48.947585 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: User-Agent: python-urllib3/1.26.9 Jun 30 11:05:48.947585 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Auth-Token: gAAAAABivYGrLve2IUh4L8jW8mhZoRjMEZxnRQxLSjSEdkCAqgqw5gWtKoYCqHRatqTQNg2ay44u7t9OZ_y1NASaicjP-oZ8N5-5g9LoA5SUINPqYX574pGxbHNUS4r4kOERVrLzrGKrFM-g1LLHEs017ETww0gs8gr_Q0upq_FaGvjmrXLZM1w Jun 30 11:05:48.947585 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Domain-Id: None Jun 30 11:05:48.947585 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Domain-Name: None Jun 30 11:05:48.947585 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Identity-Status: Confirmed Jun 30 11:05:48.947585 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Is-Admin-Project: True Jun 30 11:05:48.947585 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Domain-Id: default Jun 30 11:05:48.947585 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Domain-Name: Default Jun 30 11:05:48.947585 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Id: 5c0e9dab1a604c38a20588ca05dae79c Jun 30 11:05:48.947585 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Name: tempest-TestVolumeBootPattern-911516623 Jun 30 11:05:48.947585 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Role: member,reader Jun 30 11:05:48.947585 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Roles: member,reader Jun 30 11:05:48.949372 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5c0e9dab1a604c38a20588ca05dae79c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5c0e9dab1a604c38a20588ca05dae79c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5c0e9dab1a604c38a20588ca05dae79c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5c0e9dab1a604c38a20588ca05dae79c"}]}] Jun 30 11:05:48.949372 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant: tempest-TestVolumeBootPattern-911516623 Jun 30 11:05:48.949372 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant-Id: 5c0e9dab1a604c38a20588ca05dae79c Jun 30 11:05:48.949372 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant-Name: tempest-TestVolumeBootPattern-911516623 Jun 30 11:05:48.949372 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User: tempest-TestVolumeBootPattern-911516623-project Jun 30 11:05:48.949372 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Domain-Id: default Jun 30 11:05:48.949372 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Domain-Name: Default Jun 30 11:05:48.949372 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Id: 30cb785bf7de43e7827371820617997a Jun 30 11:05:48.949372 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Name: tempest-TestVolumeBootPattern-911516623-project Jun 30 11:05:48.949372 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: method: > Jun 30 11:05:48.949372 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: exception: Instance 37391b9e-a061-4ea4-82bb-b426a9d470d2 could not be found. Jun 30 11:05:48.949372 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: action_args: {'id': '37391b9e-a061-4ea4-82bb-b426a9d470d2'} Jun 30 11:05:48.950372 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 11:05:48.950372 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 11:05:48.950372 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 11:05:48.950372 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 11:05:48.950372 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 11:05:48.950372 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 11:05:48.950372 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 11:05:48.950372 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 11:05:48.950372 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 11:05:48.950372 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 11:05:48.950372 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37391b9e-a061-4ea4-82bb-b426a9d470d2 could not be found. Jun 30 11:05:48.950372 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 11:05:48.950372 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 11:05:48.950372 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 11:05:48.950372 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 11:05:48.950372 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 11:05:48.950372 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 11:05:48.950372 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 11:05:48.950372 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 11:05:48.950372 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 11:05:48.952110 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 11:05:48.952110 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 11:05:48.952110 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 11:05:48.952110 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 11:05:48.952110 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 11:05:48.952110 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 11:05:48.952110 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 11:05:48.952110 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37391b9e-a061-4ea4-82bb-b426a9d470d2 could not be found. Jun 30 11:05:48.952110 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 11:05:48.952110 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 11:05:48.952110 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 11:05:48.952110 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 11:05:48.952110 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 11:05:48.952110 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 11:05:48.952110 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 11:05:48.952110 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 11:05:48.952110 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37391b9e-a061-4ea4-82bb-b426a9d470d2 could not be found. Jun 30 11:05:48.952110 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 11:05:48.953594 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-a1bd5a80-56b5-4ecf-bf1c-fd15dcecd117 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Returning 404 to user: Instance 37391b9e-a061-4ea4-82bb-b426a9d470d2 could not be found. {{(pid=124203) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 11:05:48.953594 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-a1bd5a80-56b5-4ecf-bf1c-fd15dcecd117 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] 10.222.0.59 "GET /compute/v2.1/servers/37391b9e-a061-4ea4-82bb-b426a9d470d2" status: 404 len: 111 microversion: 2.1 time: 0.031587 Jun 30 11:05:48.953594 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 663/1306] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 11:05:48 2022] GET /compute/v2.1/servers/37391b9e-a061-4ea4-82bb-b426a9d470d2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 11:05:49.388421 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-2463c36e-6116-4bc0-9b9b-f8d666533a97 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Calling method '>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 11:05:49.388959 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.compute.api [None req-2463c36e-6116-4bc0-9b9b-f8d666533a97 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] [instance: bf1fb171-af43-4eca-84ca-89661ae26efa] Fetching instance by UUID {{(pid=124204) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 11:05:49.395452 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-2463c36e-6116-4bc0-9b9b-f8d666533a97 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:05:49.395892 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-2463c36e-6116-4bc0-9b9b-f8d666533a97 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:05:49.396683 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-2463c36e-6116-4bc0-9b9b-f8d666533a97 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:05:49.397112 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG oslo_concurrency.lockutils [None req-2463c36e-6116-4bc0-9b9b-f8d666533a97 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:05:49.413066 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.wsgi [None req-2463c36e-6116-4bc0-9b9b-f8d666533a97 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] HTTP exception thrown: Instance bf1fb171-af43-4eca-84ca-89661ae26efa could not be found. Jun 30 11:05:49.414677 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-2463c36e-6116-4bc0-9b9b-f8d666533a97 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Request method failure captured: Jun 30 11:05:49.414677 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: request: DELETE /compute/v2.1/servers/bf1fb171-af43-4eca-84ca-89661ae26efa HTTP/1.1 Jun 30 11:05:49.414677 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Accept: application/json Jun 30 11:05:49.414677 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Accept-Encoding: identity Jun 30 11:05:49.414677 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Connection: close Jun 30 11:05:49.414677 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Content-Length: 0 Jun 30 11:05:49.414677 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Content-Type: application/json Jun 30 11:05:49.414677 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Host: 10.222.0.59 Jun 30 11:05:49.414677 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Openstack-System-Scope: None Jun 30 11:05:49.414677 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: User-Agent: python-urllib3/1.26.9 Jun 30 11:05:49.414677 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Auth-Token: gAAAAABivYGrLve2IUh4L8jW8mhZoRjMEZxnRQxLSjSEdkCAqgqw5gWtKoYCqHRatqTQNg2ay44u7t9OZ_y1NASaicjP-oZ8N5-5g9LoA5SUINPqYX574pGxbHNUS4r4kOERVrLzrGKrFM-g1LLHEs017ETww0gs8gr_Q0upq_FaGvjmrXLZM1w Jun 30 11:05:49.414677 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Domain-Id: None Jun 30 11:05:49.414677 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Domain-Name: None Jun 30 11:05:49.414677 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Identity-Status: Confirmed Jun 30 11:05:49.414677 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Is-Admin-Project: True Jun 30 11:05:49.414677 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Domain-Id: default Jun 30 11:05:49.414677 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Domain-Name: Default Jun 30 11:05:49.414677 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Id: 5c0e9dab1a604c38a20588ca05dae79c Jun 30 11:05:49.414677 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Project-Name: tempest-TestVolumeBootPattern-911516623 Jun 30 11:05:49.414677 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Role: member,reader Jun 30 11:05:49.414677 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Roles: member,reader Jun 30 11:05:49.416381 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5c0e9dab1a604c38a20588ca05dae79c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5c0e9dab1a604c38a20588ca05dae79c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5c0e9dab1a604c38a20588ca05dae79c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5c0e9dab1a604c38a20588ca05dae79c"}]}] Jun 30 11:05:49.416381 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant: tempest-TestVolumeBootPattern-911516623 Jun 30 11:05:49.416381 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant-Id: 5c0e9dab1a604c38a20588ca05dae79c Jun 30 11:05:49.416381 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-Tenant-Name: tempest-TestVolumeBootPattern-911516623 Jun 30 11:05:49.416381 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User: tempest-TestVolumeBootPattern-911516623-project Jun 30 11:05:49.416381 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Domain-Id: default Jun 30 11:05:49.416381 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Domain-Name: Default Jun 30 11:05:49.416381 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Id: 30cb785bf7de43e7827371820617997a Jun 30 11:05:49.416381 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: X-User-Name: tempest-TestVolumeBootPattern-911516623-project Jun 30 11:05:49.416381 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: method: > Jun 30 11:05:49.416381 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: exception: Instance bf1fb171-af43-4eca-84ca-89661ae26efa could not be found. Jun 30 11:05:49.416381 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: action_args: {'id': 'bf1fb171-af43-4eca-84ca-89661ae26efa'} Jun 30 11:05:49.417301 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 11:05:49.417301 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 11:05:49.417301 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 11:05:49.417301 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 11:05:49.417301 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 11:05:49.417301 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 11:05:49.417301 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 11:05:49.417301 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 11:05:49.417301 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 11:05:49.417301 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 11:05:49.417301 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf1fb171-af43-4eca-84ca-89661ae26efa could not be found. Jun 30 11:05:49.417301 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 11:05:49.417301 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 11:05:49.417301 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 11:05:49.417301 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 11:05:49.417301 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 11:05:49.417301 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 11:05:49.417301 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 11:05:49.417301 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 11:05:49.417301 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 11:05:49.419031 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 11:05:49.419031 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 11:05:49.419031 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 11:05:49.419031 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 11:05:49.419031 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 11:05:49.419031 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 11:05:49.419031 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 11:05:49.419031 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 11:05:49.419031 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 11:05:49.419031 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf1fb171-af43-4eca-84ca-89661ae26efa could not be found. Jun 30 11:05:49.419031 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 11:05:49.419031 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 11:05:49.419031 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 11:05:49.419031 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 11:05:49.419031 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 11:05:49.419031 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 11:05:49.419031 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 11:05:49.419031 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 11:05:49.419031 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf1fb171-af43-4eca-84ca-89661ae26efa could not be found. Jun 30 11:05:49.419031 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: ERROR nova.api.openstack.wsgi Jun 30 11:05:49.420842 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-2463c36e-6116-4bc0-9b9b-f8d666533a97 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Returning 404 to user: Instance bf1fb171-af43-4eca-84ca-89661ae26efa could not be found. {{(pid=124204) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 11:05:49.420842 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-2463c36e-6116-4bc0-9b9b-f8d666533a97 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] 10.222.0.59 "DELETE /compute/v2.1/servers/bf1fb171-af43-4eca-84ca-89661ae26efa" status: 404 len: 111 microversion: 2.1 time: 0.031937 Jun 30 11:05:49.420842 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 644/1307] 10.222.0.59 () {58 vars in 1238 bytes} [Thu Jun 30 11:05:49 2022] DELETE /compute/v2.1/servers/bf1fb171-af43-4eca-84ca-89661ae26efa => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 11:05:49.424633 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-674038d9-6947-4001-a130-520b71c5f741 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Calling method '>' {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 11:05:49.425231 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.compute.api [None req-674038d9-6947-4001-a130-520b71c5f741 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] [instance: bf1fb171-af43-4eca-84ca-89661ae26efa] Fetching instance by UUID {{(pid=124203) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 11:05:49.431211 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-674038d9-6947-4001-a130-520b71c5f741 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:05:49.431653 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-674038d9-6947-4001-a130-520b71c5f741 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:05:49.432406 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-674038d9-6947-4001-a130-520b71c5f741 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 11:05:49.432861 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG oslo_concurrency.lockutils [None req-674038d9-6947-4001-a130-520b71c5f741 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Lock "426e332d-fd0b-425e-9da3-ae65045e8059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 11:05:49.445907 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.wsgi [None req-674038d9-6947-4001-a130-520b71c5f741 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] HTTP exception thrown: Instance bf1fb171-af43-4eca-84ca-89661ae26efa could not be found. Jun 30 11:05:49.447380 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-674038d9-6947-4001-a130-520b71c5f741 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Request method failure captured: Jun 30 11:05:49.447380 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: request: GET /compute/v2.1/servers/bf1fb171-af43-4eca-84ca-89661ae26efa HTTP/1.1 Jun 30 11:05:49.447380 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Accept: application/json Jun 30 11:05:49.447380 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Accept-Encoding: identity Jun 30 11:05:49.447380 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Connection: close Jun 30 11:05:49.447380 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Content-Length: 0 Jun 30 11:05:49.447380 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Content-Type: application/json Jun 30 11:05:49.447380 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Host: 10.222.0.59 Jun 30 11:05:49.447380 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Openstack-System-Scope: None Jun 30 11:05:49.447380 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: User-Agent: python-urllib3/1.26.9 Jun 30 11:05:49.447380 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Auth-Token: gAAAAABivYGrLve2IUh4L8jW8mhZoRjMEZxnRQxLSjSEdkCAqgqw5gWtKoYCqHRatqTQNg2ay44u7t9OZ_y1NASaicjP-oZ8N5-5g9LoA5SUINPqYX574pGxbHNUS4r4kOERVrLzrGKrFM-g1LLHEs017ETww0gs8gr_Q0upq_FaGvjmrXLZM1w Jun 30 11:05:49.447380 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Domain-Id: None Jun 30 11:05:49.447380 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Domain-Name: None Jun 30 11:05:49.447380 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Identity-Status: Confirmed Jun 30 11:05:49.447380 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Is-Admin-Project: True Jun 30 11:05:49.447380 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Domain-Id: default Jun 30 11:05:49.447380 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Domain-Name: Default Jun 30 11:05:49.447380 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Id: 5c0e9dab1a604c38a20588ca05dae79c Jun 30 11:05:49.447380 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Project-Name: tempest-TestVolumeBootPattern-911516623 Jun 30 11:05:49.447380 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Role: member,reader Jun 30 11:05:49.447380 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Roles: member,reader Jun 30 11:05:49.449640 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5c0e9dab1a604c38a20588ca05dae79c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5c0e9dab1a604c38a20588ca05dae79c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5c0e9dab1a604c38a20588ca05dae79c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5c0e9dab1a604c38a20588ca05dae79c"}]}] Jun 30 11:05:49.449640 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant: tempest-TestVolumeBootPattern-911516623 Jun 30 11:05:49.449640 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant-Id: 5c0e9dab1a604c38a20588ca05dae79c Jun 30 11:05:49.449640 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-Tenant-Name: tempest-TestVolumeBootPattern-911516623 Jun 30 11:05:49.449640 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User: tempest-TestVolumeBootPattern-911516623-project Jun 30 11:05:49.449640 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Domain-Id: default Jun 30 11:05:49.449640 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Domain-Name: Default Jun 30 11:05:49.449640 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Id: 30cb785bf7de43e7827371820617997a Jun 30 11:05:49.449640 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: X-User-Name: tempest-TestVolumeBootPattern-911516623-project Jun 30 11:05:49.449640 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: method: > Jun 30 11:05:49.449640 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: exception: Instance bf1fb171-af43-4eca-84ca-89661ae26efa could not be found. Jun 30 11:05:49.449640 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: action_args: {'id': 'bf1fb171-af43-4eca-84ca-89661ae26efa'} Jun 30 11:05:49.450771 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: {{(pid=124203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 11:05:49.450771 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 11:05:49.450771 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 11:05:49.450771 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 11:05:49.450771 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 11:05:49.450771 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 11:05:49.450771 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 11:05:49.450771 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 11:05:49.450771 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 11:05:49.450771 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 11:05:49.450771 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf1fb171-af43-4eca-84ca-89661ae26efa could not be found. Jun 30 11:05:49.450771 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 11:05:49.450771 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 11:05:49.450771 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 11:05:49.450771 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 11:05:49.450771 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 11:05:49.450771 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 11:05:49.450771 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 11:05:49.450771 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 11:05:49.450771 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 11:05:49.452544 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 11:05:49.452544 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 11:05:49.452544 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 11:05:49.452544 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 11:05:49.452544 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 11:05:49.452544 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 11:05:49.452544 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 11:05:49.452544 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf1fb171-af43-4eca-84ca-89661ae26efa could not be found. Jun 30 11:05:49.452544 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 11:05:49.452544 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 11:05:49.452544 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 11:05:49.452544 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 11:05:49.452544 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 11:05:49.452544 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 11:05:49.452544 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 11:05:49.452544 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 11:05:49.452544 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf1fb171-af43-4eca-84ca-89661ae26efa could not be found. Jun 30 11:05:49.452544 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: ERROR nova.api.openstack.wsgi Jun 30 11:05:49.454282 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: DEBUG nova.api.openstack.wsgi [None req-674038d9-6947-4001-a130-520b71c5f741 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Returning 404 to user: Instance bf1fb171-af43-4eca-84ca-89661ae26efa could not be found. {{(pid=124203) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 11:05:49.454282 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO nova.api.openstack.requestlog [None req-674038d9-6947-4001-a130-520b71c5f741 tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] 10.222.0.59 "GET /compute/v2.1/servers/bf1fb171-af43-4eca-84ca-89661ae26efa" status: 404 len: 111 microversion: 2.1 time: 0.027869 Jun 30 11:05:49.454282 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: [pid: 124203|app: 0|req: 664/1308] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 30 11:05:49 2022] GET /compute/v2.1/servers/bf1fb171-af43-4eca-84ca-89661ae26efa => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 11:05:50.734971 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: DEBUG nova.api.openstack.wsgi [None req-faf7388a-dc58-4720-93f9-7bc307f6450a tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] Calling method '.version_select at 0x7f4dae056e50>' {{(pid=124204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 11:05:50.758026 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO nova.api.openstack.requestlog [None req-faf7388a-dc58-4720-93f9-7bc307f6450a tempest-TestVolumeBootPattern-911516623 tempest-TestVolumeBootPattern-911516623-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1197647493" status: 202 len: 0 microversion: 2.1 time: 0.026752 Jun 30 11:05:50.758950 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: [pid: 124204|app: 0|req: 645/1309] 10.222.0.59 () {58 vars in 1262 bytes} [Thu Jun 30 11:05:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1197647493 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 11:06:54.561299 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 11:06:54.561886 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Thu Jun 30 11:06:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 11:08:32.879101 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 11:08:32.879701 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Thu Jun 30 11:08:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 11:08:37.080287 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Jun 30 11:08:37.081065 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Thu Jun 30 11:08:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 11:08:37.987436 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 11:08:37.988020 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Thu Jun 30 11:08:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 11:08:49.621766 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 11:08:49.622286 dv-cinder-822822-2-iscsi devstack@n-api.service[124204]: Thu Jun 30 11:08:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 11:08:54.612026 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 11:08:54.612651 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Thu Jun 30 11:08:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 11:10:14.569788 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 11:10:14.570500 dv-cinder-822822-2-iscsi devstack@n-api.service[124203]: Thu Jun 30 11:10:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!